Apr 15 23:13:02 devstack cinder-volume[72226]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 23:13:02 devstack cinder-volume[72226]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 23:13:02 devstack cinder-volume[72226]: we strongly recommend against using it for new projects. Apr 15 23:13:02 devstack cinder-volume[72226]: If you are already using Eventlet, we recommend migrating to a different Apr 15 23:13:02 devstack cinder-volume[72226]: framework. For more detail see Apr 15 23:13:02 devstack cinder-volume[72226]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 23:13:02 devstack cinder-volume[72226]: import eventlet # noqa Apr 15 23:13:05 devstack cinder-volume[72226]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 23:13:05 devstack cinder-volume[72226]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 23:13:05 devstack cinder-volume[72226]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 23:13:05 devstack cinder-volume[72226]: INFO dbcounter [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Registered counter for database cinder Apr 15 23:13:05 devstack cinder-volume[72226]: DEBUG oslo_db.sqlalchemy.engines [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72226) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG dbcounter [-] [72226] Writer thread running {{(pid=72226) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 23:13:06 devstack cinder-volume[72226]: INFO cinder.rpc [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 23:13:06 devstack cinder-volume[72226]: INFO cinder.rpc [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_db.sqlalchemy.engines [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72226) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:13:06 devstack cinder-volume[72226]: INFO cinder.volume.manager [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Determined volume DB was empty at startup. Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG cinder.volume.manager [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72226) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 23:13:06 devstack cinder-volume[72226]: INFO cinder.volume.manager [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 23:13:06 devstack cinder-volume[72226]: WARNING stevedore.named [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 23:13:06 devstack cinder-volume[72226]: WARNING castellan.key_manager [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 23:13:06 devstack cinder-volume[72226]: WARNING cinder.keymgr.conf_key_mgr [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG cinder.volume.drivers.lvm [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72226) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_concurrency.processutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_concurrency.processutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.330s {{(pid=72226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_db.sqlalchemy.engines [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72226) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:13:06 devstack cinder-volume[72226]: INFO cinder.rpc [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 23:13:06 devstack cinder-volume[72226]: INFO cinder.rpc [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 23:13:06 devstack cinder-volume[72226]: WARNING stevedore.named [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 23:13:06 devstack cinder-volume[72226]: WARNING castellan.key_manager [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 23:13:06 devstack cinder-volume[72226]: INFO cinder.volume.manager [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_db.sqlalchemy.engines [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72226) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:13:06 devstack cinder-volume[72226]: INFO oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Starting 1 workers Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Started child 72801 {{(pid=72226) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Full set of CONF: {{(pid=72226) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] ******************************************************************************** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Configuration options gathered from: {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] ================================================================================ {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] allow_availability_zone_fallback = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] allow_compression_on_image_upload = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] allowed_direct_url_schemes = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] api_rate_limit = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] auth_strategy = keystone {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] az_cache_duration = 3600 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_availability_zone = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_host = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_stats_polling_interval = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backup_api_class = cinder.backup.api.API {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backup_name_template = backup-%s {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backup_use_same_host = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backup_use_temp_snapshot = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] chap_password = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] chap_username = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_internal_tenant_project_id = 5dc3041fd43448b88aeb3d4f0f2173f0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_internal_tenant_user_id = 09da2bfe3b23411998b78ace0d0fbdec {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cloned_volume_same_az = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cluster = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] compression_format = gzip {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] compute_api_class = cinder.compute.nova.API {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] config_dir = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] config_source = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] control_exchange = openstack {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] debug = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] default_availability_zone = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] default_group_type = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72801]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] default_volume_type = lvmdriver-1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] disk_geometry = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] driver_client_cert = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] driver_client_cert_key = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] driver_data_namespace = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] driver_ssl_cert_path = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] driver_ssl_cert_verify = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] driver_use_ssl = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] enable_force_upload = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] enable_new_services = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] enable_unsupported_driver = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] enforce_multipath_for_image_xfer = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] filter_function = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_api_insecure = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_api_ssl_compression = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_ca_certificates_file = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_catalog_info = image:glance:publicURL {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_num_retries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance_request_timeout = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] goodness_function = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] graceful_shutdown_timeout = 5 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] group_api_class = cinder.group.api.API {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] host = devstack {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_compress_on_upload = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_conversion_address_space_limit = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_conversion_cpu_limit = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_conversion_disable = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_upload_use_cinder_backend = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_upload_use_internal_tenant = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_volume_cache_enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_volume_cache_max_count = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] image_volume_cache_max_size_gb = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] init_host_max_objects_retrieval = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] instance_format = [instance: %(uuid)s] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] iscsi_target_flags = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] iscsi_write_cache = on {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] iser_helper = tgtadm {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] iser_ip_address = 192.168.122.72 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] iser_port = 3260 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_color = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_config_append = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_dir = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_file = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_options = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_rotate_interval = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_rotate_interval_type = days {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] log_rotation_type = none {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] max_age = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] max_logfile_count = 30 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] max_logfile_size_mb = 200 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] max_over_subscription_ratio = 20.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] message_reap_interval = 86400 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] message_ttl = 2592000 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] migration_create_volume_timeout_secs = 300 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] monkey_patch = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] monkey_patch_modules = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] my_ip = 192.168.122.72 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] no_snapshot_gb_quota = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] num_iser_scan_tries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] num_shell_tries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] num_volume_device_scan_tries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] nvmeof_conn_info_version = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] nvmet_ns_id = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] nvmet_port_id = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] osapi_max_limit = 1000 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] osapi_volume_ext_list = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] osapi_volume_listen_port = 8776 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] osapi_volume_use_ssl = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] osapi_volume_workers = 2 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] per_volume_size_limit = -1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] periodic_fuzzy_delay = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] periodic_interval = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72801]: INFO cinder.volume.manager [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 23:13:06 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] public_endpoint = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] publish_errors = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] quota_backup_gigabytes = 1000 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] quota_backups = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] quota_gigabytes = 1000 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] quota_groups = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] quota_snapshots = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] quota_volumes = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] rate_limit_burst = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] rate_limit_except_level = CRITICAL {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] rate_limit_interval = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] reinit_driver_count = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] replication_device = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] report_discard_supported = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] report_interval = 120 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] reservation_clean_interval = 86400 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] reservation_expire = 86400 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] reserved_image_namespaces = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] reserved_percentage = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] rpc_response_timeout = 120 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] run_external_periodic_tasks = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] scst_target_driver = iscsi {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] scst_target_iqn_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_down_time = 720 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] shell_completion = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] snapshot_name_template = snapshot-%s {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] snapshot_same_host = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] split_loggers = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] state_path = /opt/stack/data/cinder {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] storage_availability_zone = nova {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] storage_protocol = iSCSI {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] syslog_log_facility = LOG_USER {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] target_helper = lioadm {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] target_ip_address = 192.168.122.72 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] target_port = 3260 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] target_protocol = iscsi {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] target_secondary_ip_addresses = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] trace_flags = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] transport_url = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] until_refresh = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] use_chap_auth = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] use_default_quota_class = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] use_journal = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] use_json = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] use_multipath_for_image_xfer = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] use_stderr = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] use_syslog = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] verify_glance_signatures = enabled {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_api_class = cinder.volume.api.API {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_backend_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_clear = zero {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_clear_ionice = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_clear_size = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_copy_bps_limit = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:06 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_dd_blocksize = 1M {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_name_template = volume-%s {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_service_inithost_offload = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volume_usage_audit_period = month {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] zoning_mode = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_concurrency.disable_process_locking = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.admin_password = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.admin_token = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.admin_user = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_port = 35357 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_protocol = https {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_section = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_type = password {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_uri = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.auth_version = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.cache = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.identity_uri = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.include_service_catalog = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.insecure = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.interface = public {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_password = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcache_username = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.region_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.service_type = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.backend = dogpile.cache.null {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.backend_argument = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.backend_expiration_time = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.config_prefix = cache.oslo {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.debug_cache_backend = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.enable_retry_client = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.enable_socket_keepalive = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.enforce_fips_mode = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.expiration_time = 600 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.hashclient_retry_attempts = 2 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.memcache_dead_retry = 300 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.memcache_pool_maxsize = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.memcache_sasl_enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.password = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.proxies = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.redis_db = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.redis_server = localhost:6379 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.retry_attempts = 2 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.retry_delay = 0.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.socket_keepalive_count = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.socket_keepalive_idle = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.socket_keepalive_interval = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.socket_timeout = 1.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.tls_allowed_ciphers = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.tls_cafile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.tls_certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.tls_enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.tls_keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cache.username = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] coordination.backend_url = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.asyncio_connection = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:06 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.asyncio_slave_connection = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.backend = sqlalchemy {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.connection = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.connection_debug = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.connection_parameters = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.connection_recycle_time = 3600 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.connection_trace = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.db_inc_retry_interval = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.db_max_retries = 20 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.db_max_retry_interval = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.db_retry_interval = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.max_overflow = 50 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.max_pool_size = 5 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.max_retries = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.mysql_wsrep_sync_wait = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.pool_timeout = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.retry_interval = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.slave_connection = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.sqlite_synchronous = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.synchronous_reader = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] database.use_db_reconnect = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.connection_string = messaging:// {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.es_doc_type = notification {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.es_scroll_size = 10000 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.es_scroll_time = 2m {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.filter_error_trace = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.hmac_keys = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.sentinel_service_name = mymaster {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.socket_timeout = 0.1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.trace_requests = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler.trace_sqlalchemy = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler_jaeger.process_tags = {} {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler_jaeger.service_name_prefix = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] profiler_otlp.service_name_prefix = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.enforce_new_defaults = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: WARNING oslo_config.cfg [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.enforce_scope = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.policy_default_rule = default {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.policy_file = policy.yaml {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] privsep_osbrick.group = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] privsep_osbrick.helper_command = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] privsep_osbrick.user = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_sys_admin.group = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_sys_admin.helper_command = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] cinder_sys_admin.user = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.auth_section = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:06 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.auth_type = password {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.cafile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.collect_timing = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.insecure = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.send_service_user_token = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.split_loggers = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] service_user.timeout = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.auth_section = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.auth_type = password {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.collect_timing = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack sudo[72811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 23:13:06 devstack sudo[72811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.insecure = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.region_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.split_loggers = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] glance.timeout = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.backend_availability_zone = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.chap_password = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.chap_username = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.disk_geometry = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.driver_client_cert = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.driver_client_cert_key = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.driver_data_namespace = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.driver_use_ssl = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.extra_capabilities = {} {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.filter_function = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.goodness_function = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.iscsi_target_flags = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.iscsi_write_cache = on {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.iser_helper = tgtadm {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.iser_port = 3260 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.lvm_share_target = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.lvm_type = auto {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.num_shell_tries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.replication_device = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.report_discard_supported = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.reserved_percentage = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.target_helper = tgtadm {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.target_port = 3260 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.target_protocol = iscsi {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.trace_flags = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.unique_fqdn_network = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.use_chap_auth = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_backend_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_clear = zero {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_clear_ionice = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_clear_size = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_reports.file_event_handler = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_reports.log_dir = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.backend_host = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.chap_password = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.chap_username = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.disk_geometry = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.driver_client_cert = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.extra_capabilities = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.filter_function = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.goodness_function = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.iser_helper = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.iser_ip_address = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.iser_port = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.lvm_share_target = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.lvm_type = auto {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.num_shell_tries = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.replication_device = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.report_discard_supported = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.reserved_percentage = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.scst_target_driver = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.storage_protocol = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.target_helper = lioadm {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.target_ip_address = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.target_port = 3260 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.trace_flags = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.use_chap_auth = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_clear = zero {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_clear_size = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] lvmdriver-1.volumes_dir = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.ssl = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_notifications.driver = [] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_notifications.retry = -1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] key_manager.fixed_key = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.barbican_api_version = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.barbican_endpoint = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.barbican_endpoint_type = public {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.barbican_region_name = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.cafile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.collect_timing = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.insecure = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.number_of_retries = 60 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.retry_delay = 1 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.send_service_user_token = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.split_loggers = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.timeout = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.verify_ssl = True {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican.verify_ssl_path = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.auth_section = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.auth_type = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.cafile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.certfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.collect_timing = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.insecure = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.keyfile = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.split_loggers = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] barbican_service_user.timeout = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.approle_role_id = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.approle_secret_id = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.kv_mountpoint = secret {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.kv_path = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.kv_version = 2 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.namespace = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.root_token_id = **** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.ssl_ca_crt_file = None {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.timeout = 60.0 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.use_ssl = False {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:13:06 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] ******************************************************************************** {{(pid=72226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 23:13:07 devstack sudo[72811]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:07 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:07 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:07 devstack sudo[73063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:07 devstack sudo[73063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:07 devstack sudo[73063]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:07 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.561s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:07 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:13:07 devstack cinder-volume[72801]: INFO cinder.brick.local_dev.lvm [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 23:13:08 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:08 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:08 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:08 devstack sudo[73294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:13:08 devstack sudo[73294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:08 devstack sudo[73294]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:08 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:08 devstack cinder-volume[72801]: DEBUG cinder.brick.local_dev.lvm [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72801) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 23:13:08 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:08 devstack sudo[73361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:08 devstack sudo[73361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:09 devstack sudo[73361]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.772s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:09 devstack sudo[73494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:09 devstack sudo[73494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:09 devstack sudo[73494]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:09 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:09 devstack sudo[73499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 23:13:09 devstack sudo[73499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:10 devstack sudo[73499]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:10 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.449s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:10 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:10 devstack sudo[73504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:13:10 devstack sudo[73504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:10 devstack sudo[73504]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:10 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:10 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:10 devstack sudo[73510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:13:10 devstack sudo[73510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:11 devstack sudo[73510]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:11 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:11 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:11 devstack sudo[73516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:13:11 devstack sudo[73516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:11 devstack sudo[73516]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:11 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:11 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:11 devstack sudo[73520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:11 devstack sudo[73520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:12 devstack sudo[73520]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:12 devstack sudo[73530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:12 devstack sudo[73530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:12 devstack sudo[73530]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.511s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:12 devstack cinder-volume[72801]: INFO cinder.volume.drivers.lvm [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:12 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:12 devstack sudo[73643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:12 devstack sudo[73643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:13 devstack sudo[73643]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:13 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:13 devstack cinder-volume[72801]: DEBUG cinder.volume.drivers.lvm [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Updating volume stats {{(pid=72801) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 23:13:13 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:13 devstack sudo[73707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:13:13 devstack sudo[73707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:13 devstack sudo[73707]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:13 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:13 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:13 devstack sudo[73788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:13:13 devstack sudo[73788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:14 devstack sudo[73788]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:14 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:14 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:14 devstack sudo[73791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:14 devstack sudo[73791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:14 devstack sudo[73791]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:14 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:14 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:14 devstack sudo[73795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:13:14 devstack sudo[73795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:14 devstack sudo[73795]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:14 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:14 devstack cinder-volume[72801]: INFO cinder.volume.driver [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Driver hasn't implemented _init_vendor_properties() Apr 15 23:13:14 devstack cinder-volume[72801]: DEBUG cinder.volume.driver [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72801) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG oslo_db.sqlalchemy.engines [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG dbcounter [-] [72801] Writer thread running {{(pid=72801) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG cinder.db.sqlalchemy.api [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Building query based on filter {{(pid=72801) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG cinder.image.image_utils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72801) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 23:13:15 devstack cinder-volume[72801]: INFO cinder.keymgr.migration [None req-e703bbdf-18a7-4761-9d7c-6f85f74decc1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG cinder.volume.drivers.lvm [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Updating volume stats {{(pid=72801) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:15 devstack sudo[73802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:13:15 devstack sudo[73802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:15 devstack sudo[73802]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:15 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:15 devstack sudo[73805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:13:15 devstack sudo[73805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:16 devstack sudo[73805]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:16 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:16 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:16 devstack sudo[73810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:16 devstack sudo[73810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:16 devstack sudo[73810]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:16 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:16 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:16 devstack sudo[73814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:13:16 devstack sudo[73814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:16 devstack cinder-volume[72226]: DEBUG dbcounter [-] [72226] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72226) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:13:16 devstack sudo[73814]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:16 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:16 devstack cinder-volume[72801]: DEBUG cinder.manager [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Notifying Schedulers of capabilities ... {{(pid=72801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:13:17 devstack cinder-volume[72801]: INFO cinder.volume.manager [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Driver initialization completed successfully. Apr 15 23:13:17 devstack cinder-volume[72801]: INFO cinder.manager [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Initiating service 2 cleanup Apr 15 23:13:17 devstack cinder-volume[72801]: INFO cinder.manager [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Service 2 cleanup completed. Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG cinder.service [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Creating RPC server for service cinder-volume {{(pid=72801) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG cinder.service [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72801) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 23:13:17 devstack cinder-volume[72801]: INFO cinder.volume.manager [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG cinder.volume.drivers.lvm [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Updating volume stats {{(pid=72801) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:17 devstack sudo[73822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:13:17 devstack sudo[73822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:17 devstack sudo[73822]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:17 devstack sudo[73879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:13:17 devstack sudo[73879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:17 devstack sudo[73879]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:17 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:17 devstack sudo[73882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:13:17 devstack sudo[73882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:18 devstack sudo[73882]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:18 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:18 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:13:18 devstack sudo[73885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:13:18 devstack sudo[73885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:13:18 devstack sudo[73885]: pam_unix(sudo:session): session closed for user root Apr 15 23:13:18 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:13:18 devstack cinder-volume[72801]: INFO cinder.volume.manager [None req-69c6eba2-9e4a-43e8-841c-581401d9f50a None None] Driver post RPC initialization completed successfully. Apr 15 23:13:28 devstack cinder-volume[72801]: DEBUG dbcounter [-] [72801] Writing DB stats cinder:SELECT=4 {{(pid=72801) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:13:28 devstack cinder-volume[72801]: DEBUG dbcounter [-] [72801] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72801) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:14:18 devstack cinder-volume[72801]: DEBUG oslo_service.periodic_task [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72801) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:14:18 devstack cinder-volume[72801]: DEBUG cinder.volume.drivers.lvm [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Updating volume stats {{(pid=72801) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 23:14:18 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:14:18 devstack sudo[78620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:14:18 devstack sudo[78620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:14:19 devstack sudo[78620]: pam_unix(sudo:session): session closed for user root Apr 15 23:14:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:14:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:14:19 devstack sudo[78623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:14:19 devstack sudo[78623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:14:19 devstack sudo[78623]: pam_unix(sudo:session): session closed for user root Apr 15 23:14:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:14:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:14:19 devstack sudo[78626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:14:19 devstack sudo[78626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:14:20 devstack sudo[78626]: pam_unix(sudo:session): session closed for user root Apr 15 23:14:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:14:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:14:20 devstack sudo[78629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:14:20 devstack sudo[78629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:14:20 devstack sudo[78629]: pam_unix(sudo:session): session closed for user root Apr 15 23:14:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:14:20 devstack cinder-volume[72801]: DEBUG cinder.manager [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Notifying Schedulers of capabilities ... {{(pid=72801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:15:18 devstack cinder-volume[72801]: DEBUG oslo_service.periodic_task [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72801) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:15:18 devstack cinder-volume[72801]: DEBUG cinder.volume.drivers.lvm [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Updating volume stats {{(pid=72801) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 23:15:18 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:15:18 devstack sudo[79787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:15:18 devstack sudo[79787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:15:19 devstack sudo[79787]: pam_unix(sudo:session): session closed for user root Apr 15 23:15:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:15:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:15:19 devstack sudo[79819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:15:19 devstack sudo[79819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:15:19 devstack sudo[79819]: pam_unix(sudo:session): session closed for user root Apr 15 23:15:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:15:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:15:19 devstack sudo[79853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:15:19 devstack sudo[79853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:15:20 devstack sudo[79853]: pam_unix(sudo:session): session closed for user root Apr 15 23:15:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:15:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:15:20 devstack sudo[79884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:15:20 devstack sudo[79884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:15:20 devstack sudo[79884]: pam_unix(sudo:session): session closed for user root Apr 15 23:15:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:15:20 devstack cinder-volume[72801]: DEBUG cinder.manager [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Notifying Schedulers of capabilities ... {{(pid=72801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:15:28 devstack cinder-volume[72801]: DEBUG dbcounter [-] [72801] Writing DB stats cinder:SELECT=1 {{(pid=72801) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:15:28 devstack cinder-volume[72801]: DEBUG dbcounter [-] [72801] Writing DB stats cinder:UPDATE=1 {{(pid=72801) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:16:18 devstack cinder-volume[72801]: DEBUG oslo_service.periodic_task [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72801) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:16:18 devstack cinder-volume[72801]: DEBUG cinder.volume.drivers.lvm [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Updating volume stats {{(pid=72801) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 23:16:18 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:18 devstack sudo[81479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 23:16:18 devstack sudo[81479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:19 devstack sudo[81479]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.410s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:19 devstack sudo[81482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:16:19 devstack sudo[81482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:19 devstack sudo[81482]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:19 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:19 devstack sudo[81508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 23:16:19 devstack sudo[81508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:20 devstack sudo[81508]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.410s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:20 devstack sudo[81514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 23:16:20 devstack sudo[81514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:20 devstack sudo[81514]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:20 devstack cinder-volume[72801]: DEBUG oslo_concurrency.processutils [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=72801) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:20 devstack cinder-volume[72801]: DEBUG cinder.manager [None req-e49c9cc9-8868-4482-af5d-47ede977bb55 None None] Notifying Schedulers of capabilities ... {{(pid=72801) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:16:30 devstack cinder-volume[72226]: INFO oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Caught SIGTERM, stopping children Apr 15 23:16:30 devstack cinder-volume[72226]: DEBUG oslo_concurrency.lockutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Acquiring lock "singleton_lock" {{(pid=72226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 23:16:30 devstack cinder-volume[72226]: DEBUG oslo_concurrency.lockutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Acquired lock "singleton_lock" {{(pid=72226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 23:16:30 devstack cinder-volume[72226]: DEBUG oslo_concurrency.lockutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Releasing lock "singleton_lock" {{(pid=72226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 23:16:30 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Stop services. {{(pid=72226) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 23:16:30 devstack cinder-volume[72226]: DEBUG oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Killing children. {{(pid=72226) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 23:16:30 devstack cinder-volume[72226]: INFO oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Waiting on 1 children to exit Apr 15 23:16:32 devstack cinder-volume[72801]: DEBUG oslo_concurrency.lockutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Acquiring lock "singleton_lock" {{(pid=72801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 23:16:32 devstack cinder-volume[72801]: DEBUG oslo_concurrency.lockutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Acquired lock "singleton_lock" {{(pid=72801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 23:16:32 devstack cinder-volume[72801]: DEBUG oslo_concurrency.lockutils [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Releasing lock "singleton_lock" {{(pid=72801) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 23:16:32 devstack cinder-volume[72801]: WARNING amqp [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 23:16:32 devstack cinder-volume[72801]: WARNING amqp [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 23:16:32 devstack cinder-volume[72226]: INFO oslo_service.backend._eventlet.service [None req-8ad8af90-4bd1-43bc-b528-fe4229dd3eb9 None None] Child 72801 exited with status 0 Apr 15 23:16:32 devstack cinder-volume[81859]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 23:16:32 devstack cinder-volume[81859]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 23:16:32 devstack cinder-volume[81859]: we strongly recommend against using it for new projects. Apr 15 23:16:32 devstack cinder-volume[81859]: If you are already using Eventlet, we recommend migrating to a different Apr 15 23:16:32 devstack cinder-volume[81859]: framework. For more detail see Apr 15 23:16:32 devstack cinder-volume[81859]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 23:16:32 devstack cinder-volume[81859]: import eventlet # noqa Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81859) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81859) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81859) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 23:16:34 devstack cinder-volume[81859]: INFO dbcounter [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Registered counter for database cinder Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG oslo_db.sqlalchemy.engines [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81859) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG dbcounter [-] [81859] Writer thread running {{(pid=81859) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 23:16:34 devstack cinder-volume[81859]: INFO cinder.rpc [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 23:16:34 devstack cinder-volume[81859]: INFO cinder.rpc [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG oslo_db.sqlalchemy.engines [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81859) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:34 devstack cinder-volume[81859]: INFO cinder.volume.manager [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Determined volume DB was empty at startup. Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG cinder.volume.manager [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81859) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 23:16:34 devstack cinder-volume[81859]: INFO cinder.volume.manager [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 23:16:34 devstack cinder-volume[81859]: WARNING stevedore.named [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 23:16:34 devstack cinder-volume[81859]: WARNING castellan.key_manager [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 23:16:34 devstack cinder-volume[81859]: WARNING cinder.keymgr.conf_key_mgr [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 23:16:34 devstack cinder-volume[81859]: INFO cinder.volume.manager [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 23:16:34 devstack cinder-volume[81859]: DEBUG oslo_db.sqlalchemy.engines [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81859) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:35 devstack cinder-volume[81859]: INFO oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Starting 1 workers Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Started child 81975 {{(pid=81859) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Full set of CONF: {{(pid=81859) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] ******************************************************************************** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Configuration options gathered from: {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] ================================================================================ {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] allow_availability_zone_fallback = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] allow_compression_on_image_upload = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] allowed_direct_url_schemes = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] api_rate_limit = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] auth_strategy = keystone {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_availability_zone = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_host = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_stats_polling_interval = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backup_api_class = cinder.backup.api.API {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backup_name_template = backup-%s {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backup_use_same_host = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backup_use_temp_snapshot = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] chap_password = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] chap_username = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_internal_tenant_project_id = 5dc3041fd43448b88aeb3d4f0f2173f0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_internal_tenant_user_id = 09da2bfe3b23411998b78ace0d0fbdec {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cluster = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] compression_format = gzip {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] compute_api_class = cinder.compute.nova.API {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] config_dir = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] config_source = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] control_exchange = openstack {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] debug = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] default_availability_zone = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] default_group_type = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] default_volume_type = QuobyteHD {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] disk_geometry = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] driver_client_cert = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] driver_client_cert_key = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] driver_data_namespace = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] driver_ssl_cert_path = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] driver_ssl_cert_verify = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] driver_use_ssl = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] enable_new_services = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] enable_unsupported_driver = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] enabled_backends = ['QuobyteHD'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] enforce_multipath_for_image_xfer = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] filter_function = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_api_insecure = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_api_ssl_compression = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_ca_certificates_file = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_catalog_info = image:glance:publicURL {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81975]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_num_retries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance_request_timeout = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] goodness_function = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] graceful_shutdown_timeout = 5 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] group_api_class = cinder.group.api.API {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] host = devstack {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_compress_on_upload = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_conversion_address_space_limit = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_conversion_cpu_limit = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_conversion_disable = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_upload_use_cinder_backend = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_upload_use_internal_tenant = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_volume_cache_enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_volume_cache_max_count = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] image_volume_cache_max_size_gb = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] init_host_max_objects_retrieval = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] instance_format = [instance: %(uuid)s] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] iscsi_target_flags = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] iscsi_write_cache = on {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] iser_helper = tgtadm {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] iser_ip_address = 192.168.122.72 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] iser_port = 3260 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_color = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_config_append = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_dir = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_file = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_options = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_rotate_interval = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_rotate_interval_type = days {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] log_rotation_type = none {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] max_age = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] max_logfile_count = 30 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] max_logfile_size_mb = 200 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] max_over_subscription_ratio = 20.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] message_reap_interval = 86400 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] message_ttl = 2592000 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] migration_create_volume_timeout_secs = 300 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] monkey_patch = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] monkey_patch_modules = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] my_ip = 192.168.122.72 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] no_snapshot_gb_quota = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] num_iser_scan_tries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] num_shell_tries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] num_volume_device_scan_tries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] nvmeof_conn_info_version = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] nvmet_ns_id = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] nvmet_port_id = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] osapi_max_limit = 1000 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] osapi_volume_ext_list = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] osapi_volume_listen = 0.0.0.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] osapi_volume_listen_port = 8776 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] osapi_volume_use_ssl = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] osapi_volume_workers = 2 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] per_volume_size_limit = -1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] periodic_fuzzy_delay = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] periodic_interval = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] project_id_regex = [0-9a-f\-]+ {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] public_endpoint = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] publish_errors = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] quota_backup_gigabytes = 1000 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] quota_backups = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] quota_gigabytes = 1000 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] quota_groups = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] quota_snapshots = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] quota_volumes = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] rate_limit_burst = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] rate_limit_except_level = CRITICAL {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] rate_limit_interval = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] reinit_driver_count = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] replication_device = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] report_discard_supported = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] report_interval = 120 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] reservation_clean_interval = 86400 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] reservation_expire = 86400 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] reserved_image_namespaces = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] reserved_percentage = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] rpc_response_timeout = 120 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] run_external_periodic_tasks = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] scst_target_driver = iscsi {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] scst_target_iqn_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_down_time = 720 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] shell_completion = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] snapshot_name_template = snapshot-%s {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] split_loggers = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] state_path = /opt/stack/data/cinder {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] storage_availability_zone = nova {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] storage_protocol = iSCSI {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] syslog_log_facility = LOG_USER {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] target_helper = lioadm {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] target_ip_address = 192.168.122.72 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] target_port = 3260 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81975]: INFO cinder.volume.manager [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] target_protocol = iscsi {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] target_secondary_ip_addresses = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] trace_flags = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] transfer_api_class = cinder.transfer.api.API {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] transport_url = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] until_refresh = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] use_chap_auth = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] use_default_quota_class = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] use_journal = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] use_json = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] use_multipath_for_image_xfer = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] use_stderr = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] use_syslog = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] verify_glance_signatures = enabled {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_api_class = cinder.volume.api.API {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_backend_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_clear = zero {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_clear_ionice = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_clear_size = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_copy_bps_limit = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_dd_blocksize = 1M {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_name_template = volume-%s {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_service_inithost_offload = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volume_usage_audit_period = month {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] zoning_mode = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.remotefs [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81975) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_concurrency.disable_process_locking = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.admin_password = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.admin_token = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.admin_user = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_admin_prefix = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_port = 35357 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_protocol = https {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_section = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_type = password {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_uri = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.auth_version = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.cache = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.delay_auth_decision = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.http_connect_timeout = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.identity_uri = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.include_service_catalog = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.insecure = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.interface = public {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_password = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcache_username = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.region_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.service_token_roles_required = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.service_type = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.token_cache_time = 300 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.backend = dogpile.cache.null {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.backend_argument = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.backend_expiration_time = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.config_prefix = cache.oslo {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.debug_cache_backend = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.enable_retry_client = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.enable_socket_keepalive = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.enforce_fips_mode = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.expiration_time = 600 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.hashclient_retry_attempts = 2 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.memcache_dead_retry = 300 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.memcache_pool_maxsize = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.memcache_sasl_enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.password = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.proxies = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.redis_db = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.redis_sentinel_service_name = mymaster {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.redis_server = localhost:6379 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.retry_attempts = 2 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.retry_delay = 0.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.socket_keepalive_count = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.socket_keepalive_idle = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.socket_keepalive_interval = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.socket_timeout = 1.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.tls_allowed_ciphers = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.tls_cafile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.tls_certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.tls_enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.tls_keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cache.username = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] coordination.backend_url = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.asyncio_connection = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.asyncio_slave_connection = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.backend = sqlalchemy {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.connection = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.connection_debug = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.connection_parameters = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.connection_recycle_time = 3600 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.connection_trace = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.db_inc_retry_interval = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.db_max_retries = 20 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.db_max_retry_interval = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.db_retry_interval = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.max_overflow = 50 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.max_pool_size = 5 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.max_retries = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.mysql_wsrep_sync_wait = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.pool_timeout = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.retry_interval = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.slave_connection = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.sqlite_synchronous = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.synchronous_reader = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] database.use_db_reconnect = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.connection_string = messaging:// {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.es_doc_type = notification {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.es_scroll_size = 10000 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.es_scroll_time = 2m {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.filter_error_trace = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.hmac_keys = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.sentinel_service_name = mymaster {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.socket_timeout = 0.1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.trace_requests = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler.trace_sqlalchemy = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler_jaeger.process_tags = {} {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler_jaeger.service_name_prefix = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] profiler_otlp.service_name_prefix = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.enforce_new_defaults = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: WARNING oslo_config.cfg [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.enforce_scope = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.policy_default_rule = default {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.policy_file = policy.yaml {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_policy.remote_timeout = 60.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] privsep_osbrick.group = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] privsep_osbrick.helper_command = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] privsep_osbrick.user = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_sys_admin.group = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_sys_admin.helper_command = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] cinder_sys_admin.user = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.auth_section = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.auth_type = password {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.cafile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.collect_timing = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.insecure = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.send_service_user_token = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.split_loggers = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] service_user.timeout = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.auth_section = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.auth_type = password {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.collect_timing = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.insecure = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.region_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.split_loggers = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] glance.timeout = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.backend_availability_zone = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.chap_password = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.chap_username = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.disk_geometry = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.driver_client_cert = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.driver_client_cert_key = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.driver_data_namespace = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.driver_use_ssl = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.enable_unsupported_driver = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.extra_capabilities = {} {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.filter_function = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.goodness_function = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.iscsi_target_flags = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.iscsi_write_cache = on {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.iser_helper = tgtadm {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.iser_port = 3260 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_host = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_login = admin {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_mount_options = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_password = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_private_key = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_share_path = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_ssh_port = 22 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.num_shell_tries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.nvmet_port_id = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.quobyte_client_cfg = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.quobyte_volume_url = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.replication_device = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.report_discard_supported = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.reserved_percentage = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.scst_target_driver = iscsi {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.scst_target_iqn_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.storage_protocol = iSCSI {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.target_helper = tgtadm {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.target_port = 3260 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.target_protocol = iscsi {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.trace_flags = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.unique_fqdn_network = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.use_chap_auth = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_backend_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_clear = zero {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_clear_ionice = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_clear_size = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_reports.file_event_handler = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_reports.log_dir = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.backend_availability_zone = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.backend_host = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.chap_password = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.chap_username = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.chiscsi_conf = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.disk_geometry = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81975) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.driver_client_cert = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81975]: WARNING cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.driver_client_cert_key = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81975]: WARNING cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.driver_data_namespace = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.driver_use_ssl = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.extra_capabilities = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.filter_function = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Running cmd (subprocess): mount.quobyte {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.goodness_function = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.iscsi_target_flags = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.iscsi_write_cache = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.iser_helper = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.iser_ip_address = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.iser_port = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.iser_target_prefix = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_host = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_login = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_mount_options = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_password = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_private_key = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_share_path = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_ssh_port = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.num_shell_tries = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nvmet_ns_id = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.nvmet_port_id = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.replication_device = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.report_discard_supported = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.reserved_percentage = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.scst_target_driver = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.storage_protocol = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.target_helper = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.target_ip_address = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.target_port = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.target_prefix = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.target_protocol = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.trace_flags = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.unique_fqdn_network = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.use_chap_auth = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_clear = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_clear_ionice = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_clear_size = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] QuobyteHD.volumes_dir = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.ssl = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.ssl_version = {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_notifications.driver = [] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_notifications.retry = -1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] oslo_messaging_notifications.transport_url = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] key_manager.fixed_key = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.barbican_api_version = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.barbican_endpoint = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.barbican_endpoint_type = public {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.barbican_region_name = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.cafile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.collect_timing = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.insecure = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.number_of_retries = 60 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.retry_delay = 1 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.send_service_user_token = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.split_loggers = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.timeout = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.verify_ssl = True {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican.verify_ssl_path = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.auth_section = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.auth_type = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.cafile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.certfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.collect_timing = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.insecure = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.keyfile = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.split_loggers = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] barbican_service_user.timeout = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.approle_role_id = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.approle_secret_id = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.kv_mountpoint = secret {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.kv_path = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.kv_version = 2 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.namespace = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.root_token_id = **** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.ssl_ca_crt_file = None {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.timeout = 60.0 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.use_ssl = False {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:35 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] ******************************************************************************** {{(pid=81859) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 23:16:35 devstack quobyte-client[81979]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 23:16:35 devstack quobyte-client[81979]: Invalid parameters found, error: missing mount point. Apr 15 23:16:35 devstack quobyte-client[81979]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 23:16:35 devstack quobyte-client[81979]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=81975) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:16:35 devstack cinder-volume[81975]: INFO cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 ... Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 -c /etc/quobyte/client-cinder.cfg {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:35 devstack sudo[81980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 -c /etc/quobyte/client-cinder.cfg Apr 15 23:16:35 devstack sudo[81980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:35 devstack sudo[81980]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.511s {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:35 devstack cinder-volume[81975]: INFO cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 succeeded Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=81975) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.517s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:16:35 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:35 devstack sudo[82049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:16:35 devstack sudo[82049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:36 devstack sudo[82049]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.414s {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:36 devstack cinder-volume[81975]: INFO cinder.volume.driver [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Driver hasn't implemented _init_vendor_properties() Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.volume.driver [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81975) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_db.sqlalchemy.engines [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG dbcounter [-] [81975] Writer thread running {{(pid=81975) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.db.sqlalchemy.api [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Building query based on filter {{(pid=81975) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.image.image_utils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81975) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 23:16:36 devstack cinder-volume[81975]: INFO cinder.keymgr.migration [None req-d287c338-59a3-489f-a7e7-bbd39fab921a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=81975) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=81975) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:36 devstack sudo[82052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:16:36 devstack sudo[82052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:36 devstack sudo[82052]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.403s {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.manager [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Notifying Schedulers of capabilities ... {{(pid=81975) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:16:36 devstack cinder-volume[81975]: INFO cinder.volume.manager [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Driver initialization completed successfully. Apr 15 23:16:36 devstack cinder-volume[81975]: INFO cinder.manager [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Initiating service 3 cleanup Apr 15 23:16:36 devstack cinder-volume[81975]: INFO cinder.manager [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Service 3 cleanup completed. Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.service [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Creating RPC server for service cinder-volume {{(pid=81975) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.service [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81975) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 23:16:36 devstack cinder-volume[81975]: INFO cinder.volume.manager [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=81975) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=81975) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:16:36 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:36 devstack sudo[82056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:16:36 devstack sudo[82056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:37 devstack sudo[82056]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:37 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.417s {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:37 devstack cinder-volume[81975]: INFO cinder.volume.manager [None req-3189fba9-da4f-4b9d-8bde-7080d17579ca None None] Driver post RPC initialization completed successfully. Apr 15 23:16:39 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:16:39 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:16:39 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=81975) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:16:39 devstack cinder-volume[81975]: DEBUG cinder.volume.drivers.quobyte [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=81975) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:16:39 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81975) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:16:39 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:39 devstack sudo[82122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:16:39 devstack sudo[82122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:40 devstack sudo[82122]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:40 devstack cinder-volume[81975]: DEBUG oslo_concurrency.processutils [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.371s {{(pid=81975) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:40 devstack cinder-volume[81975]: DEBUG cinder.manager [None req-a64e79d6-7d8e-4dd4-9f4b-76cf4d67664f None None] Notifying Schedulers of capabilities ... {{(pid=81975) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:16:42 devstack cinder-volume[81859]: INFO oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Caught SIGTERM, stopping children Apr 15 23:16:42 devstack cinder-volume[81859]: DEBUG oslo_concurrency.lockutils [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Acquiring lock "singleton_lock" {{(pid=81859) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 23:16:42 devstack cinder-volume[81859]: DEBUG oslo_concurrency.lockutils [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Acquired lock "singleton_lock" {{(pid=81859) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 23:16:42 devstack cinder-volume[81859]: DEBUG oslo_concurrency.lockutils [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Releasing lock "singleton_lock" {{(pid=81859) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 23:16:42 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Stop services. {{(pid=81859) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 23:16:42 devstack cinder-volume[81859]: DEBUG oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Killing children. {{(pid=81859) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 23:16:42 devstack cinder-volume[81859]: INFO oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Waiting on 1 children to exit Apr 15 23:16:45 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Acquiring lock "singleton_lock" {{(pid=81975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 23:16:45 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Acquired lock "singleton_lock" {{(pid=81975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 23:16:45 devstack cinder-volume[81975]: DEBUG oslo_concurrency.lockutils [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Releasing lock "singleton_lock" {{(pid=81975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 23:16:45 devstack cinder-volume[81975]: WARNING amqp [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 23:16:45 devstack cinder-volume[81975]: WARNING amqp [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 23:16:45 devstack cinder-volume[81859]: INFO oslo_service.backend._eventlet.service [None req-e2250fd5-4114-4433-9e1f-18d5dbbcf7af None None] Child 81975 exited with status 0 Apr 15 23:16:45 devstack cinder-volume[82202]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 23:16:45 devstack cinder-volume[82202]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 23:16:45 devstack cinder-volume[82202]: we strongly recommend against using it for new projects. Apr 15 23:16:45 devstack cinder-volume[82202]: If you are already using Eventlet, we recommend migrating to a different Apr 15 23:16:45 devstack cinder-volume[82202]: framework. For more detail see Apr 15 23:16:45 devstack cinder-volume[82202]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 23:16:45 devstack cinder-volume[82202]: import eventlet # noqa Apr 15 23:16:46 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 23:16:46 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 23:16:46 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 23:16:47 devstack cinder-volume[82202]: INFO dbcounter [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Registered counter for database cinder Apr 15 23:16:47 devstack cinder-volume[82202]: DEBUG oslo_db.sqlalchemy.engines [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:47 devstack cinder-volume[82202]: DEBUG dbcounter [-] [82202] Writer thread running {{(pid=82202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 23:16:47 devstack cinder-volume[82202]: INFO cinder.rpc [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 23:16:47 devstack cinder-volume[82202]: INFO cinder.rpc [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 23:16:47 devstack cinder-volume[82202]: DEBUG oslo_db.sqlalchemy.engines [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:47 devstack cinder-volume[82202]: INFO cinder.volume.manager [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Determined volume DB was empty at startup. Apr 15 23:16:47 devstack cinder-volume[82202]: DEBUG cinder.volume.manager [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82202) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 23:16:47 devstack cinder-volume[82202]: WARNING stevedore.named [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 23:16:47 devstack cinder-volume[82202]: WARNING castellan.key_manager [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 23:16:47 devstack cinder-volume[82202]: WARNING cinder.keymgr.conf_key_mgr [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 23:16:48 devstack cinder-volume[82202]: INFO cinder.volume.manager [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_db.sqlalchemy.engines [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:48 devstack cinder-volume[82202]: INFO oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Starting 1 workers Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Started child 82388 {{(pid=82202) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Full set of CONF: {{(pid=82202) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] ******************************************************************************** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Configuration options gathered from: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] ================================================================================ {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] allow_availability_zone_fallback = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] allow_compression_on_image_upload = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] allowed_direct_url_schemes = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] api_rate_limit = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] auth_strategy = keystone {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_availability_zone = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_host = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_stats_polling_interval = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backup_api_class = cinder.backup.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backup_name_template = backup-%s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backup_use_same_host = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backup_use_temp_snapshot = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] chap_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] chap_username = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_internal_tenant_project_id = 5dc3041fd43448b88aeb3d4f0f2173f0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_internal_tenant_user_id = 09da2bfe3b23411998b78ace0d0fbdec {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cluster = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] compression_format = gzip {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] compute_api_class = cinder.compute.nova.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] config_dir = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] config_source = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] control_exchange = openstack {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] debug = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] default_availability_zone = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] default_group_type = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] default_volume_type = QuobyteHD {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] disk_geometry = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82388]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] driver_client_cert = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] driver_client_cert_key = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] driver_data_namespace = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] driver_ssl_cert_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] driver_ssl_cert_verify = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] driver_use_ssl = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] enable_new_services = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] enable_unsupported_driver = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] enabled_backends = ['QuobyteHD'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] enforce_multipath_for_image_xfer = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] filter_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_api_insecure = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_api_ssl_compression = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_ca_certificates_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_catalog_info = image:glance:publicURL {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_num_retries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance_request_timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] goodness_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] graceful_shutdown_timeout = 5 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] group_api_class = cinder.group.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] host = devstack {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_compress_on_upload = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_conversion_address_space_limit = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_conversion_cpu_limit = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_conversion_disable = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_upload_use_cinder_backend = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_upload_use_internal_tenant = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_volume_cache_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_volume_cache_max_count = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] image_volume_cache_max_size_gb = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] init_host_max_objects_retrieval = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] instance_format = [instance: %(uuid)s] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] iscsi_target_flags = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] iscsi_write_cache = on {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] iser_helper = tgtadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] iser_ip_address = 192.168.122.72 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] iser_port = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_color = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_config_append = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_dir = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_options = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_rotate_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_rotate_interval_type = days {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] log_rotation_type = none {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] max_age = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] max_logfile_count = 30 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] max_logfile_size_mb = 200 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] max_over_subscription_ratio = 20.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] message_reap_interval = 86400 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] message_ttl = 2592000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] migration_create_volume_timeout_secs = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] monkey_patch = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] monkey_patch_modules = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] my_ip = 192.168.122.72 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] no_snapshot_gb_quota = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] num_iser_scan_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] num_shell_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] num_volume_device_scan_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] nvmeof_conn_info_version = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] nvmet_ns_id = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] nvmet_port_id = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] osapi_max_limit = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] osapi_volume_ext_list = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] osapi_volume_listen_port = 8776 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] osapi_volume_use_ssl = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] osapi_volume_workers = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] per_volume_size_limit = -1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] periodic_fuzzy_delay = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] periodic_interval = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] public_endpoint = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] publish_errors = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] quota_backup_gigabytes = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] quota_backups = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] quota_gigabytes = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] quota_groups = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] quota_snapshots = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] quota_volumes = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] rate_limit_burst = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] rate_limit_except_level = CRITICAL {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] rate_limit_interval = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] reinit_driver_count = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] replication_device = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] report_discard_supported = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] report_interval = 120 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] reservation_clean_interval = 86400 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] reservation_expire = 86400 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] reserved_image_namespaces = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] reserved_percentage = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] rpc_response_timeout = 120 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] run_external_periodic_tasks = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] scst_target_driver = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] scst_target_iqn_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_down_time = 720 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] shell_completion = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] snapshot_name_template = snapshot-%s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] split_loggers = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] state_path = /opt/stack/data/cinder {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] storage_availability_zone = nova {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] storage_protocol = iSCSI {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] syslog_log_facility = LOG_USER {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] target_helper = lioadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] target_ip_address = 192.168.122.72 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] target_port = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] target_protocol = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] target_secondary_ip_addresses = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] trace_flags = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] transport_url = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] until_refresh = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] use_chap_auth = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] use_default_quota_class = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] use_journal = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] use_json = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] use_multipath_for_image_xfer = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] use_stderr = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] use_syslog = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] verify_glance_signatures = enabled {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_api_class = cinder.volume.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_backend_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_clear = zero {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_clear_ionice = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_clear_size = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_copy_bps_limit = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_dd_blocksize = 1M {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_name_template = volume-%s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_service_inithost_offload = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volume_usage_audit_period = month {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] zoning_mode = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_concurrency.disable_process_locking = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.admin_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.admin_token = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.admin_user = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_admin_prefix = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_port = 35357 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_protocol = https {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_section = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_type = password {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_uri = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.auth_version = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.cache = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.identity_uri = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.include_service_catalog = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.insecure = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.interface = public {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_password = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcache_username = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82388) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.region_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.service_token_roles_required = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.service_type = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.backend = dogpile.cache.null {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.backend_argument = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.backend_expiration_time = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.config_prefix = cache.oslo {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.debug_cache_backend = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.enable_retry_client = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.enable_socket_keepalive = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.enforce_fips_mode = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.expiration_time = 600 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.hashclient_retry_attempts = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.memcache_dead_retry = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.memcache_pool_maxsize = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.memcache_sasl_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.proxies = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.redis_db = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.redis_server = localhost:6379 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.retry_attempts = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.retry_delay = 0.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.socket_keepalive_count = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.socket_keepalive_idle = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.socket_keepalive_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.socket_timeout = 1.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.tls_allowed_ciphers = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.tls_cafile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.tls_certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.tls_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.tls_keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cache.username = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] coordination.backend_url = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.asyncio_connection = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.asyncio_slave_connection = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.backend = sqlalchemy {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.connection = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.connection_debug = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.connection_parameters = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.connection_recycle_time = 3600 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.connection_trace = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.db_inc_retry_interval = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.db_max_retries = 20 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.db_max_retry_interval = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.db_retry_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.max_overflow = 50 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.max_pool_size = 5 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.max_retries = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.mysql_wsrep_sync_wait = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.pool_timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.retry_interval = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.slave_connection = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.sqlite_synchronous = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.synchronous_reader = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] database.use_db_reconnect = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.connection_string = messaging:// {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.es_doc_type = notification {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.es_scroll_size = 10000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.es_scroll_time = 2m {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.filter_error_trace = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.hmac_keys = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.sentinel_service_name = mymaster {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.socket_timeout = 0.1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.trace_requests = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler.trace_sqlalchemy = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler_jaeger.process_tags = {} {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler_jaeger.service_name_prefix = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] profiler_otlp.service_name_prefix = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.enforce_new_defaults = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: WARNING oslo_config.cfg [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.enforce_scope = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.policy_default_rule = default {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.policy_file = policy.yaml {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] privsep_osbrick.group = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] privsep_osbrick.helper_command = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] privsep_osbrick.user = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_sys_admin.group = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_sys_admin.helper_command = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] cinder_sys_admin.user = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.auth_section = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.auth_type = password {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.cafile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.collect_timing = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.insecure = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.send_service_user_token = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.split_loggers = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] service_user.timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.auth_section = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.auth_type = password {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.collect_timing = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.insecure = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.region_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.split_loggers = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] glance.timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.backend_availability_zone = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.chap_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.chap_username = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.disk_geometry = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.driver_client_cert = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.driver_client_cert_key = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.driver_data_namespace = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.driver_use_ssl = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.extra_capabilities = {} {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.filter_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.goodness_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.iscsi_target_flags = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.iscsi_write_cache = on {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.iser_helper = tgtadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.iser_port = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_host = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_login = admin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_mount_options = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_private_key = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_share_path = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_ssh_port = 22 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.num_shell_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.quobyte_client_cfg = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.quobyte_volume_url = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.replication_device = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.report_discard_supported = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.reserved_percentage = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.target_helper = tgtadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.target_port = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.target_protocol = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.trace_flags = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.unique_fqdn_network = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.use_chap_auth = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_backend_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_clear = zero {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_clear_ionice = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_clear_size = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_reports.file_event_handler = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_reports.log_dir = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.backend_availability_zone = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.backend_host = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.chap_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.chap_username = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.chiscsi_conf = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.disk_geometry = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.driver_client_cert = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.driver_client_cert_key = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.driver_data_namespace = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.driver_use_ssl = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.extra_capabilities = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.filter_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.goodness_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.iscsi_target_flags = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.iscsi_write_cache = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.iser_helper = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.iser_ip_address = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.iser_port = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.iser_target_prefix = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_host = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_login = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_mount_options = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_private_key = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_share_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_ssh_port = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.num_shell_tries = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nvmet_ns_id = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.nvmet_port_id = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.replication_device = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.report_discard_supported = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.reserved_percentage = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.scst_target_driver = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.storage_protocol = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.target_helper = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.target_ip_address = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.target_port = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.target_prefix = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.target_protocol = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.trace_flags = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.unique_fqdn_network = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.use_chap_auth = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_clear = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_clear_ionice = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_clear_size = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] QuobyteHD.volumes_dir = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.ssl = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_notifications.driver = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_notifications.retry = -1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] key_manager.fixed_key = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.barbican_api_version = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.barbican_endpoint = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82388) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.barbican_endpoint_type = public {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.barbican_region_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.cafile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.collect_timing = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.insecure = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Running cmd (subprocess): mount.quobyte {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.number_of_retries = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.retry_delay = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.send_service_user_token = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.split_loggers = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.verify_ssl = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican.verify_ssl_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.auth_section = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.auth_type = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.cafile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.collect_timing = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.insecure = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.split_loggers = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] barbican_service_user.timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.approle_role_id = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.approle_secret_id = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.kv_mountpoint = secret {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.kv_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.kv_version = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.namespace = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.root_token_id = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.ssl_ca_crt_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.timeout = 60.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.use_ssl = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 23:16:48 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-29c6c3b4-fc9a-4766-aea4-eac2ea002e6d None None] ******************************************************************************** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 23:16:48 devstack quobyte-client[82415]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 23:16:48 devstack quobyte-client[82415]: Invalid parameters found, error: missing mount point. Apr 15 23:16:48 devstack quobyte-client[82415]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 23:16:48 devstack quobyte-client[82415]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:48 devstack sudo[82417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:16:48 devstack sudo[82417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:48 devstack sudo[82417]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.403s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:48 devstack cinder-volume[82388]: INFO cinder.volume.driver [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Driver hasn't implemented _init_vendor_properties() Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.volume.driver [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82388) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_db.sqlalchemy.engines [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writer thread running {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.db.sqlalchemy.api [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Building query based on filter {{(pid=82388) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82388) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:16:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:48 devstack cinder-volume[82388]: INFO cinder.keymgr.migration [None req-2e6351f2-0800-44ab-b40b-cc9144d04be3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 23:16:48 devstack sudo[82438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:16:48 devstack sudo[82438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:49 devstack sudo[82438]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.450s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:16:49 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Driver initialization completed successfully. Apr 15 23:16:49 devstack cinder-volume[82388]: INFO cinder.manager [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Initiating service 3 cleanup Apr 15 23:16:49 devstack cinder-volume[82388]: INFO cinder.manager [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Service 3 cleanup completed. Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG cinder.service [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Creating RPC server for service cinder-volume {{(pid=82388) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG cinder.service [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82388) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 23:16:49 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:16:49 devstack sudo[82447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:16:49 devstack sudo[82447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:16:49 devstack sudo[82447]: pam_unix(sudo:session): session closed for user root Apr 15 23:16:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.401s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:16:49 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ddc69320-be7e-41d0-960e-2b36a0a97b9a None None] Driver post RPC initialization completed successfully. Apr 15 23:16:58 devstack cinder-volume[82202]: DEBUG dbcounter [-] [82202] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:16:59 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=3 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:16:59 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Flow 'volume_create_manager' (f9c607e4-1dca-4ac2-b6df-e333592a3dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8e9b05-9fab-4573-82d5-32eb5d50da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8e9b05-9fab-4573-82d5-32eb5d50da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2073401078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a4cb44-b860-47c0-9ba6-1bc7606c666f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37ac9253462421199a88a86c9f0ab36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:49Z,use_quota=True,user_id='ae75bbe58f034b9b884f141ac59d691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29815abe-2b74-4ddc-910e-af38259d06dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29815abe-2b74-4ddc-910e-af38259d06dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0daed3-c8ca-484e-a0f5-b216a8661a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0daed3-c8ca-484e-a0f5-b216a8661a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a4cb44-b860-47c0-9ba6-1bc7606c666f', 'volume_name': 'volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5278b8f0-89b4-4b68-b376-046ebe038494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5278b8f0-89b4-4b68-b376-046ebe038494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a23a2ff-b64f-41e9-a7a0-7b33de75b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:49 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Volume e8a4cb44-b860-47c0-9ba6-1bc7606c666f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f', 'volume_size': 1} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2073401078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a4cb44-b860-47c0-9ba6-1bc7606c666f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37ac9253462421199a88a86c9f0ab36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:49Z,use_quota=True,user_id='ae75bbe58f034b9b884f141ac59d691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Creating volume e8a4cb44-b860-47c0-9ba6-1bc7606c666f {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:17:49 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:49 devstack sudo[83026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f 1073741824 Apr 15 23:17:49 devstack sudo[83026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Flow 'volume_create_manager' (2162fc27-4b65-4ab2-a407-10b2c0a4c518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:17:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f57c55-d2d4-49c0-9b12-8039ef35aaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f57c55-d2d4-49c0-9b12-8039ef35aaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2005516662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d41992-9b7b-4972-a03e-20a428bb04f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c593a0f4f584a349a190ece013dbafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:50Z,use_quota=True,user_id='0471bdf42799423588d5a61da771c5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d3f328-2e86-4150-966f-50e432671372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d3f328-2e86-4150-966f-50e432671372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2b28d8-1874-49a0-97b5-e24a54a8f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2b28d8-1874-49a0-97b5-e24a54a8f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d41992-9b7b-4972-a03e-20a428bb04f6', 'volume_name': 'volume-93d41992-9b7b-4972-a03e-20a428bb04f6', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cc1815-5881-469f-b14d-5baf04e7e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cc1815-5881-469f-b14d-5baf04e7e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524b82ed-afc0-48cb-94f5-86ce5a4181af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Volume 93d41992-9b7b-4972-a03e-20a428bb04f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d41992-9b7b-4972-a03e-20a428bb04f6', 'volume_size': 1} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Flow 'volume_create_manager' (7de746c8-587a-422a-932c-200769d48b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e350f977-fe45-4344-98e5-75378583b171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e350f977-fe45-4344-98e5-75378583b171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-386261984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eaacd13-fa14-4826-b4a0-c114b9cba3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd252f5638f45fe816c46ef95548eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:50Z,use_quota=True,user_id='f4fce4504d67400abefd50e0b8bcccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6878e044-afea-4548-82d8-76158bc48a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6878e044-afea-4548-82d8-76158bc48a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9578fb-2e8f-4945-8a84-920b971103fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9578fb-2e8f-4945-8a84-920b971103fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eaacd13-fa14-4826-b4a0-c114b9cba3f7', 'volume_name': 'volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948939ae-80ad-4607-979d-04d44a4e2811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948939ae-80ad-4607-979d-04d44a4e2811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e04525-f963-4ab8-b95a-b599a2422e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:50 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Volume 6eaacd13-fa14-4826-b4a0-c114b9cba3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7', 'volume_size': 1} Apr 15 23:17:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:17:51 devstack sudo[83026]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f 1073741824" returned: 0 in 1.974s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:17:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:51 devstack sudo[83350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f Apr 15 23:17:51 devstack sudo[83350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:52 devstack sudo[83350]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f" returned: 0 in 1.128s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] <== create_volume: return (3191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.193s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2005516662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d41992-9b7b-4972-a03e-20a428bb04f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c593a0f4f584a349a190ece013dbafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:50Z,use_quota=True,user_id='0471bdf42799423588d5a61da771c5bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Creating volume 93d41992-9b7b-4972-a03e-20a428bb04f6 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:17:52 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a23a2ff-b64f-41e9-a7a0-7b33de75b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8caab8-d4cf-409f-936d-42a4b7183e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:52 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Volume volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f (e8a4cb44-b860-47c0-9ba6-1bc7606c666f): created successfully Apr 15 23:17:52 devstack sudo[83353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 1073741824 Apr 15 23:17:52 devstack sudo[83353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8caab8-d4cf-409f-936d-42a4b7183e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Flow 'volume_create_manager' (f9c607e4-1dca-4ac2-b6df-e333592a3dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:17:52 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d4f8867e-2102-4703-bfc3-3b3e3e27e440 tempest-DeleteServersTestJSON-1010616462 None] Created volume successfully. Apr 15 23:17:53 devstack sudo[83353]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 1073741824" returned: 0 in 0.841s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:17:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:53 devstack sudo[83377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 Apr 15 23:17:53 devstack sudo[83377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:54 devstack sudo[83377]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6" returned: 0 in 0.901s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.015s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-386261984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eaacd13-fa14-4826-b4a0-c114b9cba3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd252f5638f45fe816c46ef95548eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:17:50Z,use_quota=True,user_id='f4fce4504d67400abefd50e0b8bcccfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Creating volume 6eaacd13-fa14-4826-b4a0-c114b9cba3f7 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:17:54 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524b82ed-afc0-48cb-94f5-86ce5a4181af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d41992-9b7b-4972-a03e-20a428bb04f6', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001b1189-bcc7-45a1-8d67-05bf34674fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:54 devstack sudo[83386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 1073741824 Apr 15 23:17:54 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Volume volume-93d41992-9b7b-4972-a03e-20a428bb04f6 (93d41992-9b7b-4972-a03e-20a428bb04f6): created successfully Apr 15 23:17:54 devstack sudo[83386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001b1189-bcc7-45a1-8d67-05bf34674fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Flow 'volume_create_manager' (2162fc27-4b65-4ab2-a407-10b2c0a4c518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:17:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-fc98140c-b7c5-4ddb-9a48-51684cb669ad req-4519e7c3-0e04-4427-a0a3-1abef802b79c tempest-VolumesGetTestJSON-1004363042 None] Created volume successfully. Apr 15 23:17:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Acquiring lock "cinder-93d41992-9b7b-4972-a03e-20a428bb04f6-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:17:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Lock "cinder-93d41992-9b7b-4972-a03e-20a428bb04f6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:17:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Acquiring lock "cinder-quobyte-93d41992-9b7b-4972-a03e-20a428bb04f6" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:17:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Lock "cinder-quobyte-93d41992-9b7b-4972-a03e-20a428bb04f6" acquired by "delete_volume" :: waited 0.046s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:17:55 devstack sudo[83386]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:55 devstack cinder-volume[82388]: INFO oslo.privsep.daemon [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqlgm7y0t/privsep.sock'] Apr 15 23:17:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 1073741824" returned: 0 in 1.124s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:17:55 devstack sudo[83393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqlgm7y0t/privsep.sock Apr 15 23:17:55 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:55 devstack sudo[83396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 Apr 15 23:17:55 devstack sudo[83396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 23:17:56 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 23:17:56 devstack sudo[83396]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7" returned: 0 in 0.969s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:17:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:17:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:17:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e04525-f963-4ab8-b95a-b599a2422e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d6f853-cea2-44cc-8865-bf558e0b50e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:17:56 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Volume volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 (6eaacd13-fa14-4826-b4a0-c114b9cba3f7): created successfully Apr 15 23:17:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d6f853-cea2-44cc-8865-bf558e0b50e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:17:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Flow 'volume_create_manager' (7de746c8-587a-422a-932c-200769d48b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:17:56 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-02ac7981-ac98-4566-a666-161e9b0dca13 tempest-ServerRescueNegativeTestJSON-1889010443 None] Created volume successfully. Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 23:17:57 devstack cinder-volume[82388]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 23:17:58 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:58 devstack cinder-volume[82388]: INFO oslo.privsep.daemon [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Spawned new privsep daemon via rootwrap Apr 15 23:17:58 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Accepted privsep connection to /tmp/tmpqlgm7y0t/privsep.sock {{(pid=82388) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 23:17:58 devstack cinder-volume[82388]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 23:17:58 devstack cinder-volume[82388]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 23:17:58 devstack cinder-volume[82388]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 23:17:58 devstack cinder-volume[82388]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83406 Apr 15 23:17:58 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[4858ef91-98f4-4039-a9a4-b9bcc87bfa16]: (2,) {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:17:58 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3f73d1-6ea5-447e-99e0-34fd2ec2d471]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:17:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:58 devstack sudo[83411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 Apr 15 23:17:58 devstack sudo[83411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:17:59 devstack sudo[83411]: pam_unix(sudo:session): session closed for user root Apr 15 23:17:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6" returned: 0 in 1.301s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:17:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:17:59 devstack sudo[83428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6 Apr 15 23:17:59 devstack sudo[83428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:00 devstack sudo[83428]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93d41992-9b7b-4972-a03e-20a428bb04f6" returned: 0 in 0.596s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Lock "cinder-quobyte-93d41992-9b7b-4972-a03e-20a428bb04f6" released by "delete_volume" :: held 4.773s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:00 devstack cinder-volume[82388]: WARNING cinder.quota [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:00 devstack cinder-volume[82388]: WARNING cinder.quota [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG cinder.quota [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Created reservations ['e986e44f-ae88-448e-a4d6-e69452b4ec23', 'ab85cd8a-93ca-4f5c-8cc2-03db12fd28e7', 'dcf16880-d1d1-40ad-b50b-8dc617dadee0', 'eecfd07c-c668-454d-a7f4-1d5ee16f1460'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:00 devstack sudo[83438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:00 devstack sudo[83438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:01 devstack cinder-volume[82388]: WARNING py.warnings [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 15 23:18:01 devstack cinder-volume[82388]: .first() Apr 15 23:18:01 devstack cinder-volume[82388]: Apr 15 23:18:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:01 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6908e49a-bf10-451d-aec1-736b96d638e9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:01 devstack sudo[83438]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.870s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:01 devstack cinder-volume[82388]: DEBUG cinder.manager [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Deleted volume successfully. Apr 15 23:18:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-13ada557-0feb-42ca-86ed-f97925e54222 req-cce20ff0-a0c5-4f2b-b7ba-143ea84c6dfd tempest-VolumesGetTestJSON-1004363042 None] Lock "cinder-93d41992-9b7b-4972-a03e-20a428bb04f6-delete_volume" released by "delete_volume" :: held 6.211s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:01 devstack sudo[83453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f Apr 15 23:18:01 devstack sudo[83453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:02 devstack sudo[83453]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f" returned: 0 in 1.163s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.248s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037', 'name': 'volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66ff398e-d436-4bc3-a4be-2ee8f8fad3bc', 'enforce_multipath': True} {{(pid=82388) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 23:18:02 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-904d623f-f27f-4cb2-a189-aad53d8b9098 req-e27a5cda-9ba0-49b0-a842-bc1dbc7141b5 tempest-DeleteServersTestJSON-1010616462 None] attachment_update completed successfully. Apr 15 23:18:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-53d23821-d5b4-49dc-a877-881b8892c2f4 tempest-GroupSnapshotsV319Test-1651256871 None] Group tempest-GroupSnapshotsV319Test-Group-776823066: creating Apr 15 23:18:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-53d23821-d5b4-49dc-a877-881b8892c2f4 tempest-GroupSnapshotsV319Test-1651256871 None] Group tempest-GroupSnapshotsV319Test-Group-776823066: created successfully Apr 15 23:18:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-53d23821-d5b4-49dc-a877-881b8892c2f4 tempest-GroupSnapshotsV319Test-1651256871 None] Create group completed successfully. Apr 15 23:18:14 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-1e4c7eab-f7c6-495a-96ec-dfe51ecab6f5 req-67912b6b-e6aa-47b4-8544-47e73c2461c6 tempest-DeleteServersTestJSON-1010616462 None] Terminate volume connection completed successfully. Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-1e4c7eab-f7c6-495a-96ec-dfe51ecab6f5 req-67912b6b-e6aa-47b4-8544-47e73c2461c6 tempest-DeleteServersTestJSON-1010616462 None] Deleting attachment 66ff398e-d436-4bc3-a4be-2ee8f8fad3bc. {{(pid=82388) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Flow 'volume_create_manager' (c745f56d-8ab1-4148-a37f-5fbe1e4153ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9924963a-f337-4421-9855-99194bf948cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9924963a-f337-4421-9855-99194bf948cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727940109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3d190cd-afe5-4d37-8f02-f642074a3533,host='devstack@QuobyteHD#QuobyteHD',id=2a1de23f-8b41-45a5-97e1-a340f57a96b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e28643a601467ebd67917ef0b37a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:15Z,use_quota=True,user_id='457bec71984b4795a56354a8db4f83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fde0f01-f1ef-4683-866a-6fe958f56ddd),volume_type_id=9fde0f01-f1ef-4683-866a-6fe958f56ddd)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956062b-c23e-4734-b7f0-91e538a236ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956062b-c23e-4734-b7f0-91e538a236ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9e911d-bfbe-4e12-be5f-738c9621e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9e911d-bfbe-4e12-be5f-738c9621e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1de23f-8b41-45a5-97e1-a340f57a96b3', 'volume_name': 'volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1db8fda-57e9-4854-9a83-bcf4b0e7d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1db8fda-57e9-4854-9a83-bcf4b0e7d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3a4c3f-7601-4d4c-aec0-6b1b9ba48cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Volume 2a1de23f-8b41-45a5-97e1-a340f57a96b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3', 'volume_size': 1} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3d190cd-afe5-4d37-8f02-f642074a3533,created_at=2026-04-15T21:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727940109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3d190cd-afe5-4d37-8f02-f642074a3533,host='devstack@QuobyteHD#QuobyteHD',id=2a1de23f-8b41-45a5-97e1-a340f57a96b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e28643a601467ebd67917ef0b37a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:15Z,use_quota=True,user_id='457bec71984b4795a56354a8db4f83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fde0f01-f1ef-4683-866a-6fe958f56ddd),volume_type_id=9fde0f01-f1ef-4683-866a-6fe958f56ddd)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Creating volume 2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:18:14 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:14 devstack sudo[84017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 1073741824 Apr 15 23:18:14 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:14 devstack sudo[84018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:14 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:15 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 1073741824" returned: 0 in 0.752s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:15 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 Apr 15 23:18:15 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:15 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.952s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:16 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3" returned: 0 in 0.655s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3a4c3f-7601-4d4c-aec0-6b1b9ba48cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c7ec49-e178-4344-8714-a3f84ac65f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:16 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Volume volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 (2a1de23f-8b41-45a5-97e1-a340f57a96b3): created successfully Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c7ec49-e178-4344-8714-a3f84ac65f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Flow 'volume_create_manager' (c745f56d-8ab1-4148-a37f-5fbe1e4153ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:18:16 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-218de932-7f4d-4e4c-82d5-a13050e7daea tempest-GroupSnapshotsV319Test-1651256871 None] Created volume successfully. Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Acquiring lock "cinder-6eaacd13-fa14-4826-b4a0-c114b9cba3f7-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "cinder-6eaacd13-fa14-4826-b4a0-c114b9cba3f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Acquiring lock "cinder-quobyte-6eaacd13-fa14-4826-b4a0-c114b9cba3f7" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "cinder-quobyte-6eaacd13-fa14-4826-b4a0-c114b9cba3f7" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d95afb2-b9e1-4780-a097-036f48c83a64]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:16 devstack sudo[84085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 Apr 15 23:18:16 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:17 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] GroupSnapshot e9556b18-67c5-48de-ab81-be9e1a885a93: creating. Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Group snapshot e9556b18-67c5-48de-ab81-be9e1a885a93: creating. {{(pid=82388) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Creating offline snapshot 191a508a-2dfa-4905-9be9-393d40e6e207 of volume 2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0229130b-82d2-40e5-8c62-ecccfc1b876b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:17 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:17 devstack sudo[84090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 Apr 15 23:18:17 devstack sudo[84090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:17 devstack sudo[84091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7 Apr 15 23:18:17 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:17 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6eaacd13-fa14-4826-b4a0-c114b9cba3f7" returned: 0 in 0.524s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "cinder-quobyte-6eaacd13-fa14-4826-b4a0-c114b9cba3f7" released by "delete_volume" :: held 1.166s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Created reservations ['429e8abd-23d9-4ec9-9a3c-cb2b21e1522d', 'ec9bd6ed-03bd-482a-9641-5967afb800dc', '30021ed4-7c9f-49dd-b441-a47318b24eee', 'de7a3d4b-92a5-4687-afb9-4637a5f0bf5b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:18 devstack sudo[84099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:18 devstack sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:18 devstack sudo[84090]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3" returned: 0 in 0.842s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:18 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 1G Apr 15 23:18:18 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:18 devstack sudo[84099]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.556s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Deleted volume successfully. Apr 15 23:18:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e36a84a5-5ad3-4566-bfc7-85c1d149e697 tempest-ServerRescueNegativeTestJSON-1889010443 None] Lock "cinder-6eaacd13-fa14-4826-b4a0-c114b9cba3f7-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:19 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 1G" returned: 0 in 0.854s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:19 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 Apr 15 23:18:19 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:20 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207" returned: 0 in 1.013s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:20 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:20 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 Apr 15 23:18:20 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:20 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207" returned: 0 in 0.653s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Acquiring lock "cinder-e8a4cb44-b860-47c0-9ba6-1bc7606c666f-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Lock "cinder-e8a4cb44-b860-47c0-9ba6-1bc7606c666f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:20 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.info Apr 15 23:18:20 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Acquiring lock "cinder-quobyte-e8a4cb44-b860-47c0-9ba6-1bc7606c666f" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Lock "cinder-quobyte-e8a4cb44-b860-47c0-9ba6-1bc7606c666f" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c142b239-bd99-4a4f-b07e-fd03565fa980]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:21 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f Apr 15 23:18:21 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:21 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.info" returned: 0 in 0.735s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:21 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:18:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:21 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.info Apr 15 23:18:21 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:21 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f" returned: 0 in 0.708s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:21 devstack sudo[84175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f Apr 15 23:18:21 devstack sudo[84175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:21 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.info" returned: 0 in 0.470s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.639s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:22 devstack sudo[84175]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e8a4cb44-b860-47c0-9ba6-1bc7606c666f" returned: 0 in 0.514s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Lock "cinder-quobyte-e8a4cb44-b860-47c0-9ba6-1bc7606c666f" released by "delete_volume" :: held 1.261s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5b9df63e-618d-4893-8e99-5eac177ca9f6 tempest-GroupSnapshotsV319Test-1651256871 None] group_snapshot e9556b18-67c5-48de-ab81-be9e1a885a93: created successfully Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Created reservations ['4d2bc97e-3668-4023-a96c-0e8151931e63', '90a7230a-1d5e-4e61-910f-48231b1f4049', 'bc545a1c-2a2a-4015-bc29-dc721631f38d', 'b8f06928-934d-44e0-85b4-1e2b13e1ff80'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:22 devstack sudo[84182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:22 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:22 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.421s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Deleted volume successfully. Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5f1615fa-b707-47ee-b9bf-3d071cb05b9a tempest-DeleteServersTestJSON-1010616462 None] Lock "cinder-e8a4cb44-b860-47c0-9ba6-1bc7606c666f-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] group_snapshot e9556b18-67c5-48de-ab81-be9e1a885a93: deleting Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] group_snapshot e9556b18-67c5-48de-ab81-be9e1a885a93: deleting {{(pid=82388) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Acquiring lock "cinder-quobyte-2a1de23f-8b41-45a5-97e1-a340f57a96b3" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Lock "cinder-quobyte-2a1de23f-8b41-45a5-97e1-a340f57a96b3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Acquiring lock "cinder-quobyte-191a508a-2dfa-4905-9be9-393d40e6e207" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Lock "cinder-quobyte-191a508a-2dfa-4905-9be9-393d40e6e207" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Deleting offline snapshot 191a508a-2dfa-4905-9be9-393d40e6e207 of volume 2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] snapshot_file for this snap is: volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef4947-e56c-4870-a187-11fe9d78b141]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:23 devstack sudo[84186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 Apr 15 23:18:23 devstack sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:23 devstack sudo[84186]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207" returned: 0 in 0.795s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b907f-2e56-4170-951f-1dd88b582a7e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:23 devstack sudo[84194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 Apr 15 23:18:23 devstack sudo[84194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:24 devstack sudo[84194]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3" returned: 0 in 0.595s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:24 devstack sudo[84200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 Apr 15 23:18:24 devstack sudo[84200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:24 devstack sudo[84200]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:25 devstack sudo[84205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207 Apr 15 23:18:25 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:25 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3.191a508a-2dfa-4905-9be9-393d40e6e207" returned: 0 in 0.650s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Lock "cinder-quobyte-191a508a-2dfa-4905-9be9-393d40e6e207" released by "_delete_snapshot" :: held 2.657s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Lock "cinder-quobyte-2a1de23f-8b41-45a5-97e1-a340f57a96b3" released by "delete_snapshot" :: held 2.676s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:25 devstack cinder-volume[82388]: WARNING cinder.quota [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2129553615 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2129553615, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:25 devstack cinder-volume[82388]: WARNING cinder.quota [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2129553615 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2129553615, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:25 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] Created reservations ['61ebae5d-1f71-413b-8149-39bb2583ae6b', '4c4f1891-9eba-41f5-9c60-8c5f433db6ce', '3c704f78-2990-403f-82b1-8ede8e94b4bf', '84f29cbc-3318-4bec-92a2-02967bcdad08'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:25 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-89089ea0-adb3-4133-a598-4e060c31ec03 tempest-GroupSnapshotsV319Test-1651256871 None] group_snapshot e9556b18-67c5-48de-ab81-be9e1a885a93: deleted successfully Apr 15 23:18:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Acquiring lock "cinder-quobyte-2a1de23f-8b41-45a5-97e1-a340f57a96b3" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Lock "cinder-quobyte-2a1de23f-8b41-45a5-97e1-a340f57a96b3" acquired by "delete_volume" :: waited 0.018s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:26 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec0c2d-0d34-46ec-8fd3-9a84959ece84]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:26 devstack sudo[84240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 Apr 15 23:18:26 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:27 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3" returned: 0 in 0.729s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:27 devstack sudo[84268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3 Apr 15 23:18:27 devstack sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Flow 'volume_create_manager' (f0d21320-3e23-4bef-868a-acdb3c947823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de416727-7fac-430b-944a-6fe4062e68ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de416727-7fac-430b-944a-6fe4062e68ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-219405709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bbbd40-4eae-4090-b550-072e302c6764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acb320560844197b79cffdd0b4082c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:28Z,use_quota=True,user_id='ae7f989ae2e64261a6f2cb06ebf74080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4df42d3-92f4-4561-8156-979835f25d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4df42d3-92f4-4561-8156-979835f25d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a78cb9-99cc-48f1-827a-a5d331e80bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a78cb9-99cc-48f1-827a-a5d331e80bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bbbd40-4eae-4090-b550-072e302c6764', 'volume_name': 'volume-52bbbd40-4eae-4090-b550-072e302c6764', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6075d24-66c6-499b-b74a-6599dbf46f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6075d24-66c6-499b-b74a-6599dbf46f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be884d6b-01af-43f3-b32d-a62321074912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Volume 52bbbd40-4eae-4090-b550-072e302c6764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bbbd40-4eae-4090-b550-072e302c6764', 'volume_size': 1} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-219405709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bbbd40-4eae-4090-b550-072e302c6764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acb320560844197b79cffdd0b4082c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:28Z,use_quota=True,user_id='ae7f989ae2e64261a6f2cb06ebf74080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Creating volume 52bbbd40-4eae-4090-b550-072e302c6764 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:18:28 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:28 devstack sudo[84274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 1073741824 Apr 15 23:18:28 devstack sudo[84268]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:28 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2a1de23f-8b41-45a5-97e1-a340f57a96b3" returned: 0 in 0.766s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Lock "cinder-quobyte-2a1de23f-8b41-45a5-97e1-a340f57a96b3" released by "delete_volume" :: held 1.600s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Created reservations ['e6bbc688-844f-48fb-bd78-b333daeedf39'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:28 devstack cinder-volume[82388]: WARNING cinder.quota [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2129553615 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2129553615, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Created reservations ['9a280f72-7480-493f-96b0-a5df3a4b7308', '17f06921-96b9-4936-9103-49eeb0adf60e', '8edd54ef-b1fd-4317-8fd1-99579c8760cb', '10c3b2db-0362-4641-a0ea-d58f75972b42'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:28 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:28 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:28 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 1073741824" returned: 0 in 0.668s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:29 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 Apr 15 23:18:29 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:29 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.862s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-95aa45da-4f86-4397-8e9d-1c6d4d3c9a4b tempest-GroupSnapshotsV319Test-1651256871 None] Delete group completed successfully. Apr 15 23:18:29 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764" returned: 0 in 0.674s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be884d6b-01af-43f3-b32d-a62321074912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bbbd40-4eae-4090-b550-072e302c6764', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b538714-fedf-465f-bd72-a97459d9d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:29 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Volume volume-52bbbd40-4eae-4090-b550-072e302c6764 (52bbbd40-4eae-4090-b550-072e302c6764): created successfully Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b538714-fedf-465f-bd72-a97459d9d16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Flow 'volume_create_manager' (f0d21320-3e23-4bef-868a-acdb3c947823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:18:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-61a4d00c-b392-492e-8c10-b69b2e23d98d tempest-VolumesAdminNegativeTest-655298975 None] Created volume successfully. Apr 15 23:18:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Acquiring lock "cinder-52bbbd40-4eae-4090-b550-072e302c6764-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Lock "cinder-52bbbd40-4eae-4090-b550-072e302c6764-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Acquiring lock "cinder-quobyte-52bbbd40-4eae-4090-b550-072e302c6764" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Lock "cinder-quobyte-52bbbd40-4eae-4090-b550-072e302c6764" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:30 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3270c72-2ed2-4be0-ba66-6d216ba1c8bc]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:30 devstack sudo[84287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 Apr 15 23:18:30 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-0149edb2-881f-4f82-ac5b-a79a1685e8c8 tempest-BackendsCapabilitiesAdminTestsJSON-540870226 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82388) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 23:18:31 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764" returned: 0 in 0.521s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:31 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764 Apr 15 23:18:31 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-688d6efd-ca14-4a49-a1cc-8dc820c71635 tempest-BackendsCapabilitiesAdminTestsJSON-540870226 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7328147888184, 'free_capacity_gb': 1775.7328147888184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82388) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 23:18:31 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-52bbbd40-4eae-4090-b550-072e302c6764" returned: 0 in 0.461s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Lock "cinder-quobyte-52bbbd40-4eae-4090-b550-072e302c6764" released by "delete_volume" :: held 1.011s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Created reservations ['b0173444-4f0f-4f60-8fa7-19403da0ac6c', '29d44ea1-8ec4-4d65-884b-27f3901f5f6d', 'c55a4dd3-f6c4-469a-8bf3-660474ce821d', '1b1affd5-dd09-4ee9-92aa-3bc0aaa6bc9f'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:31 devstack sudo[84297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:31 devstack sudo[84297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:32 devstack sudo[84297]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.554s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:32 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:32 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Deleted volume successfully. Apr 15 23:18:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5a14c2f7-11c6-4eb7-8ef7-9a9a850b76c8 tempest-VolumesAdminNegativeTest-655298975 None] Lock "cinder-52bbbd40-4eae-4090-b550-072e302c6764-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-313d3eb1-07fe-4b16-92c2-ac470c3a7605 tempest-GroupSnapshotsTest-1888157014 None] Group tempest-GroupSnapshotsTest-Group-1536192867: creating Apr 15 23:18:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-313d3eb1-07fe-4b16-92c2-ac470c3a7605 tempest-GroupSnapshotsTest-1888157014 None] Group tempest-GroupSnapshotsTest-Group-1536192867: created successfully Apr 15 23:18:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-313d3eb1-07fe-4b16-92c2-ac470c3a7605 tempest-GroupSnapshotsTest-1888157014 None] Create group completed successfully. Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (26f9d986-0f6f-4901-b4bc-d9e89e6418e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30626eca-0a20-483d-a74a-12385f7d522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30626eca-0a20-483d-a74a-12385f7d522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142414317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d854983c-06f2-463e-8d20-0fa310d9551f,host='devstack@QuobyteHD#QuobyteHD',id=c4379031-c857-4f3d-83e5-2659028b9f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:38Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a2b393-2993-4bfd-b23b-d29f0fc85e81),volume_type_id=79a2b393-2993-4bfd-b23b-d29f0fc85e81)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8565907-5638-4127-82df-ded15f927f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8565907-5638-4127-82df-ded15f927f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d38b90b-e438-408c-8771-3b8fc66baa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d38b90b-e438-408c-8771-3b8fc66baa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4379031-c857-4f3d-83e5-2659028b9f63', 'volume_name': 'volume-c4379031-c857-4f3d-83e5-2659028b9f63', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f5ab34-2f14-4e54-912e-bed10e4e4f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f5ab34-2f14-4e54-912e-bed10e4e4f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae864d3-6b1f-40f3-bdb3-0c6059569dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:37 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Volume c4379031-c857-4f3d-83e5-2659028b9f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4379031-c857-4f3d-83e5-2659028b9f63', 'volume_size': 1} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d854983c-06f2-463e-8d20-0fa310d9551f,created_at=2026-04-15T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142414317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d854983c-06f2-463e-8d20-0fa310d9551f,host='devstack@QuobyteHD#QuobyteHD',id=c4379031-c857-4f3d-83e5-2659028b9f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:18:38Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79a2b393-2993-4bfd-b23b-d29f0fc85e81),volume_type_id=79a2b393-2993-4bfd-b23b-d29f0fc85e81)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Creating volume c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:18:37 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:18:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:37 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 1073741824 Apr 15 23:18:37 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:38 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 1073741824" returned: 0 in 0.582s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:38 devstack sudo[84345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 Apr 15 23:18:38 devstack sudo[84345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:39 devstack sudo[84345]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63" returned: 0 in 0.492s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:18:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae864d3-6b1f-40f3-bdb3-0c6059569dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4379031-c857-4f3d-83e5-2659028b9f63', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedb0c95-b626-47e0-9a91-a5e1e5999507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:18:39 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Volume volume-c4379031-c857-4f3d-83e5-2659028b9f63 (c4379031-c857-4f3d-83e5-2659028b9f63): created successfully Apr 15 23:18:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedb0c95-b626-47e0-9a91-a5e1e5999507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:18:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (26f9d986-0f6f-4901-b4bc-d9e89e6418e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:18:39 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ccbf2387-f42c-43e4-8046-85475e28638b tempest-GroupSnapshotsTest-1888157014 None] Created volume successfully. Apr 15 23:18:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] GroupSnapshot 6bf5d871-ec5c-4ba6-b9c3-5d80d5218b57: creating. Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=62,cinder:UPDATE=89,cinder:DELETE=7,cinder:INSERT=16 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Group snapshot 6bf5d871-ec5c-4ba6-b9c3-5d80d5218b57: creating. {{(pid=82388) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Creating offline snapshot d5706290-26ee-4fa6-80e1-85b394af087d of volume c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9708811d-564b-4266-a3c9-82ecbf24d4cd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:40 devstack sudo[84348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 Apr 15 23:18:40 devstack sudo[84348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:40 devstack sudo[84348]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63" returned: 0 in 0.656s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:40 devstack sudo[84353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d 1G Apr 15 23:18:40 devstack sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:41 devstack sudo[84353]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d 1G" returned: 0 in 0.601s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4379031-c857-4f3d-83e5-2659028b9f63 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:41 devstack sudo[84360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4379031-c857-4f3d-83e5-2659028b9f63 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d Apr 15 23:18:41 devstack sudo[84360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:42 devstack sudo[84360]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4379031-c857-4f3d-83e5-2659028b9f63 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:42 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:18:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:42 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d Apr 15 23:18:42 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:42 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d" returned: 0 in 0.624s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:42 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.info Apr 15 23:18:42 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:43 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.info" returned: 0 in 0.624s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:43 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:18:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:43 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.info Apr 15 23:18:43 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:43 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.info" returned: 0 in 0.612s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.694s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f265d276-7193-45d5-8818-475a4e5c3634 tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 6bf5d871-ec5c-4ba6-b9c3-5d80d5218b57: created successfully Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-d5706290-26ee-4fa6-80e1-85b394af087d-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d5706290-26ee-4fa6-80e1-85b394af087d-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Creating volume 9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 from snapshot d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] snapshot: d5706290-26ee-4fa6-80e1-85b394af087d, volume: 9dfd6704-e01a-4ce7-9008-ad2dedf70cd5, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[28518d51-96a2-4253-8ccd-9e80b36ce06a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:45 devstack sudo[84377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d Apr 15 23:18:45 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:46 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d" returned: 0 in 0.622s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4379031-c857-4f3d-83e5-2659028b9f63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7265f6-308f-43be-a819-cc592b18784d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:46 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 Apr 15 23:18:46 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:46 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63" returned: 0 in 0.651s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:18:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:46 devstack sudo[84387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 Apr 15 23:18:46 devstack sudo[84387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:49 devstack sudo[84387]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" returned: 0 in 2.601s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8686050-7f1b-4320-9597-569dadaba2ba]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:49 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 Apr 15 23:18:49 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:49 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=60,cinder:SELECT=73,cinder:INSERT=16,cinder:DELETE=3 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:18:50 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63" returned: 0 in 0.713s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:50 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63, size 1024.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:18:50 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Converted 1024.00 MB image at 393.50 MB/s Apr 15 23:18:50 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:18:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:50 devstack sudo[84421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 Apr 15 23:18:50 devstack sudo[84421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:50 devstack sudo[84421]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" returned: 0 in 0.635s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" released by "_copy_volume_from_snapshot" :: held 5.290s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d5706290-26ee-4fa6-80e1-85b394af087d-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" released by "_create_volume_from_snapshot" :: held 5.312s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.323s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:50 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-285da1d1-d794-4271-b87e-a11fb7175602 tempest-GroupSnapshotsTest-1888157014 None] Create group from source-snapshot-6bf5d871-ec5c-4ba6-b9c3-5d80d5218b57 completed successfully. Apr 15 23:18:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:51 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[612eb6ca-6af6-4ed2-9243-edee62903916]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:51 devstack sudo[84434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 Apr 15 23:18:51 devstack sudo[84434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:52 devstack sudo[84434]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" returned: 0 in 0.627s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:52 devstack sudo[84440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5 Apr 15 23:18:52 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:52 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" returned: 0 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-9dfd6704-e01a-4ce7-9008-ad2dedf70cd5" released by "delete_volume" :: held 1.158s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:52 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['c2c7101a-fcb3-49f1-8acf-337ddcf49e77'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:52 devstack cinder-volume[82388]: WARNING cinder.quota [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1476622186 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1476622186, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:52 devstack cinder-volume[82388]: WARNING cinder.quota [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1476622186 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1476622186, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:52 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['2eb105fc-e31e-4345-a1a8-5856b5d04cd1', '6bf517f0-48e3-45de-8c1c-a4c5dffe8901', '68b4b284-75d5-42eb-9330-c0ccb3d4a8e4', 'c251ae12-ce81-4fb9-a8cc-dcad519aea61'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:53 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:53 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:53 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.495s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:53 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5edf4a2c-4ca7-479b-8b14-c8951913a28b tempest-GroupSnapshotsTest-1888157014 None] Delete group completed successfully. Apr 15 23:18:53 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 6bf5d871-ec5c-4ba6-b9c3-5d80d5218b57: deleting Apr 15 23:18:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 6bf5d871-ec5c-4ba6-b9c3-5d80d5218b57: deleting {{(pid=82388) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-c4379031-c857-4f3d-83e5-2659028b9f63" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-c4379031-c857-4f3d-83e5-2659028b9f63" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-d5706290-26ee-4fa6-80e1-85b394af087d" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d5706290-26ee-4fa6-80e1-85b394af087d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Deleting offline snapshot d5706290-26ee-4fa6-80e1-85b394af087d of volume c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] snapshot_file for this snap is: volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb2241-113b-45ed-9332-eccaf1659ce1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:54 devstack sudo[84446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d Apr 15 23:18:54 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:54 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d" returned: 0 in 0.559s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4379031-c857-4f3d-83e5-2659028b9f63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[659b2a43-ae20-4b1d-98b2-cecc685018f5]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:54 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 Apr 15 23:18:54 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:55 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63" returned: 0 in 0.532s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:55 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d Apr 15 23:18:55 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:55 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d" returned: 0 in 0.617s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:55 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d Apr 15 23:18:55 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:56 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63.d5706290-26ee-4fa6-80e1-85b394af087d" returned: 0 in 0.503s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d5706290-26ee-4fa6-80e1-85b394af087d" released by "_delete_snapshot" :: held 2.296s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-c4379031-c857-4f3d-83e5-2659028b9f63" released by "delete_snapshot" :: held 2.309s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:56 devstack cinder-volume[82388]: WARNING cinder.quota [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1476622186 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1476622186, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:18:56 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['39d28e19-0ee8-40a4-9d4a-2f87db2fe68d', '95fcb81b-0696-4d63-8a95-a8b3f9e486d1', 'afde322e-4fc8-4114-b957-c2a80c0271f1', 'fd672660-ef74-45e4-9334-670da4525e50'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:56 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5b9ec992-5bdc-47de-97a0-6a247266adcb tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 6bf5d871-ec5c-4ba6-b9c3-5d80d5218b57: deleted successfully Apr 15 23:18:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-c4379031-c857-4f3d-83e5-2659028b9f63" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:18:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-c4379031-c857-4f3d-83e5-2659028b9f63" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:18:57 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2aa892-0c2c-48bd-b032-52c974401d04]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:18:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:57 devstack sudo[84466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 Apr 15 23:18:57 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:57 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63" returned: 0 in 0.567s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:58 devstack sudo[84471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63 Apr 15 23:18:58 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:58 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4379031-c857-4f3d-83e5-2659028b9f63" returned: 0 in 0.486s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-c4379031-c857-4f3d-83e5-2659028b9f63" released by "delete_volume" :: held 1.088s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['352ee044-067f-409d-808a-2798d56ae62f'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:58 devstack cinder-volume[82388]: WARNING cinder.db.sqlalchemy.api [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1476622186'] Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['7ccbe772-603c-4187-b98a-b19ab88a5a4d', 'a529632b-266b-472b-b3a1-b34b975354f4', 'f5864479-0d69-49cb-b69f-1ccd63fc1c3a', '39be572d-dbdc-4ab4-8bba-9008a8a7ad49'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:18:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:18:58 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:18:58 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:18:59 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 15 23:18:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.590s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:18:59 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:18:59 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a5aa7dac-2dcb-4d50-9aaa-da021b510b2e tempest-GroupSnapshotsTest-1888157014 None] Delete group completed successfully. Apr 15 23:18:59 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-14b7b92d-caca-427e-9f4c-142a6e316d3c tempest-GroupSnapshotsTest-1888157014 None] Group tempest-GroupSnapshotsTest-Group-1812040670: creating Apr 15 23:19:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-14b7b92d-caca-427e-9f4c-142a6e316d3c tempest-GroupSnapshotsTest-1888157014 None] Group tempest-GroupSnapshotsTest-Group-1812040670: created successfully Apr 15 23:19:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-14b7b92d-caca-427e-9f4c-142a6e316d3c tempest-GroupSnapshotsTest-1888157014 None] Create group completed successfully. Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (c9cb1d92-320a-440e-b9b5-95bffceed80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858787b3-340a-4f57-a4c7-a6fdd6b33743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858787b3-340a-4f57-a4c7-a6fdd6b33743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1908384854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27884318-35f0-4a60-91e7-ff78c9f3827f,host='devstack@QuobyteHD#QuobyteHD',id=d6499d99-1bed-4e49-a0ba-4c355cd3e8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:02Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc5c79ec-68c9-42bc-85b7-23a708a5e15f),volume_type_id=fc5c79ec-68c9-42bc-85b7-23a708a5e15f)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af953244-c0bf-47a3-ade7-61fc47ddeb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af953244-c0bf-47a3-ade7-61fc47ddeb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62d0bc3-8540-40af-97db-3b453520eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62d0bc3-8540-40af-97db-3b453520eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6499d99-1bed-4e49-a0ba-4c355cd3e8a9', 'volume_name': 'volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d18fc9-48aa-4a62-a179-8970222b3a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d18fc9-48aa-4a62-a179-8970222b3a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37821c9-5a63-4de5-9480-354e0825c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:01 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Volume d6499d99-1bed-4e49-a0ba-4c355cd3e8a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9', 'volume_size': 1} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27884318-35f0-4a60-91e7-ff78c9f3827f,created_at=2026-04-15T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1908384854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27884318-35f0-4a60-91e7-ff78c9f3827f,host='devstack@QuobyteHD#QuobyteHD',id=d6499d99-1bed-4e49-a0ba-4c355cd3e8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:02Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc5c79ec-68c9-42bc-85b7-23a708a5e15f),volume_type_id=fc5c79ec-68c9-42bc-85b7-23a708a5e15f)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Creating volume d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:01 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:01 devstack sudo[84501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 1073741824 Apr 15 23:19:01 devstack sudo[84501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:02 devstack sudo[84501]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 1073741824" returned: 0 in 0.688s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:02 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 Apr 15 23:19:02 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:02 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" returned: 0 in 0.563s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37821c9-5a63-4de5-9480-354e0825c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b01a17-cd10-40d2-8869-8f4b1b6e27f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:02 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Volume volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 (d6499d99-1bed-4e49-a0ba-4c355cd3e8a9): created successfully Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b01a17-cd10-40d2-8869-8f4b1b6e27f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (c9cb1d92-320a-440e-b9b5-95bffceed80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:02 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-9c44eb57-6eb8-4a8f-b75c-2c3d4c1e5891 tempest-GroupSnapshotsTest-1888157014 None] Created volume successfully. Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (20cfb9e3-0155-4346-863e-200cd4eb8ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3acf65c-042a-43ef-9e40-b13b871a8a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3acf65c-042a-43ef-9e40-b13b871a8a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-464351747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27884318-35f0-4a60-91e7-ff78c9f3827f,host='devstack@QuobyteHD#QuobyteHD',id=80459b2c-0917-4e05-840f-3afdd66ed5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:04Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc5c79ec-68c9-42bc-85b7-23a708a5e15f),volume_type_id=fc5c79ec-68c9-42bc-85b7-23a708a5e15f)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21707101-d8b6-403c-a0cf-c5772b767f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21707101-d8b6-403c-a0cf-c5772b767f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54a2d75-39e8-4726-b935-04cb54daf56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54a2d75-39e8-4726-b935-04cb54daf56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80459b2c-0917-4e05-840f-3afdd66ed5eb', 'volume_name': 'volume-80459b2c-0917-4e05-840f-3afdd66ed5eb', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceec30ec-32cf-4025-ac11-8c52e0436ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceec30ec-32cf-4025-ac11-8c52e0436ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817fbd62-ad85-4e34-9c28-f897bdc88815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:03 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Volume 80459b2c-0917-4e05-840f-3afdd66ed5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80459b2c-0917-4e05-840f-3afdd66ed5eb', 'volume_size': 1} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27884318-35f0-4a60-91e7-ff78c9f3827f,created_at=2026-04-15T21:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-464351747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27884318-35f0-4a60-91e7-ff78c9f3827f,host='devstack@QuobyteHD#QuobyteHD',id=80459b2c-0917-4e05-840f-3afdd66ed5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:04Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc5c79ec-68c9-42bc-85b7-23a708a5e15f),volume_type_id=fc5c79ec-68c9-42bc-85b7-23a708a5e15f)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Creating volume 80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:03 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:04 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb 1073741824 Apr 15 23:19:04 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:04 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb 1073741824" returned: 0 in 0.635s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:04 devstack sudo[84540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb Apr 15 23:19:04 devstack sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:05 devstack sudo[84540]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb" returned: 0 in 0.493s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817fbd62-ad85-4e34-9c28-f897bdc88815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80459b2c-0917-4e05-840f-3afdd66ed5eb', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28259ace-f754-470d-81b0-22ee30629e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:05 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Volume volume-80459b2c-0917-4e05-840f-3afdd66ed5eb (80459b2c-0917-4e05-840f-3afdd66ed5eb): created successfully Apr 15 23:19:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28259ace-f754-470d-81b0-22ee30629e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (20cfb9e3-0155-4346-863e-200cd4eb8ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b3244704-5388-4a05-8ff9-8bfd3dbaca0d tempest-GroupSnapshotsTest-1888157014 None] Created volume successfully. Apr 15 23:19:06 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-9498e22d-05e8-4eeb-b195-cbee3d169a16 tempest-GroupSnapshotsTest-1888157014 None] Update group completed successfully. Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (c3eb8969-9382-4fc7-8621-e89f0a1bbe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cf1556-36b8-4a9c-b340-6bd7cdcc6b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cf1556-36b8-4a9c-b340-6bd7cdcc6b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-281820607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f4f904-f7da-4388-8568-a1abaf8b5e0b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:07Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9c5aa8-c038-4b92-bede-1a11abe0c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9c5aa8-c038-4b92-bede-1a11abe0c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075696ae-6082-449c-83bf-4c3e9727ec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075696ae-6082-449c-83bf-4c3e9727ec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f4f904-f7da-4388-8568-a1abaf8b5e0b', 'volume_name': 'volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300ac77d-6c08-4fb8-9fbb-50c23c83a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300ac77d-6c08-4fb8-9fbb-50c23c83a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6baff7-e4e5-48d1-985e-ff821008e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:06 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Volume c9f4f904-f7da-4388-8568-a1abaf8b5e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b', 'volume_size': 1} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-281820607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f4f904-f7da-4388-8568-a1abaf8b5e0b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:07Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Creating volume c9f4f904-f7da-4388-8568-a1abaf8b5e0b {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:06 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:06 devstack sudo[84586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b 1073741824 Apr 15 23:19:06 devstack sudo[84586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:07 devstack sudo[84586]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b 1073741824" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:07 devstack sudo[84591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b Apr 15 23:19:07 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-da9bd5ba-22eb-478c-a0b1-8565ac991465 tempest-GroupSnapshotsTest-1888157014 None] Update group completed successfully. Apr 15 23:19:07 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b" returned: 0 in 0.424s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6baff7-e4e5-48d1-985e-ff821008e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4eface-114e-418e-abfb-3585a6c0a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:07 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Volume volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b (c9f4f904-f7da-4388-8568-a1abaf8b5e0b): created successfully Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4eface-114e-418e-abfb-3585a6c0a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (c3eb8969-9382-4fc7-8621-e89f0a1bbe68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-96272e9a-5e6f-4b9f-bdaa-a2d1ee53f862 tempest-VolumesGetTest-1105881524 None] Created volume successfully. Apr 15 23:19:08 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5a83da25-f648-4430-87be-d7a40759107e tempest-GroupSnapshotsTest-1888157014 None] Update group completed successfully. Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (e9ee30a1-69e3-451d-aa06-00e2d803be56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16b5217-6ea7-44fb-95c4-aa74192440b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16b5217-6ea7-44fb-95c4-aa74192440b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1083405239',display_name='tempest-VolumesGetTest-Volume-492431179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0730009d-e538-40bb-8076-fd7786c5c188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:09Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51bd6b5-b2f4-4442-b992-a5a546549c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51bd6b5-b2f4-4442-b992-a5a546549c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5631c-1402-4c9c-9f84-8ed5cb6a6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5631c-1402-4c9c-9f84-8ed5cb6a6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0730009d-e538-40bb-8076-fd7786c5c188', 'volume_name': 'volume-0730009d-e538-40bb-8076-fd7786c5c188', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd0b074-59d9-403f-9df0-8d509c07dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd0b074-59d9-403f-9df0-8d509c07dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae77e51e-cf0e-41d4-92dd-16c8348a0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:09 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Volume 0730009d-e538-40bb-8076-fd7786c5c188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0730009d-e538-40bb-8076-fd7786c5c188', 'volume_size': 1} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1083405239',display_name='tempest-VolumesGetTest-Volume-492431179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0730009d-e538-40bb-8076-fd7786c5c188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:09Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Creating volume 0730009d-e538-40bb-8076-fd7786c5c188 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:09 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:09 devstack sudo[84599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 1073741824 Apr 15 23:19:09 devstack sudo[84599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:09 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8136e906-8483-44f2-890d-f7b5eb3dd6a9 tempest-GroupSnapshotsTest-1888157014 None] Update group completed successfully. Apr 15 23:19:10 devstack sudo[84599]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 1073741824" returned: 0 in 0.831s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:10 devstack sudo[84620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 Apr 15 23:19:10 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:10 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188" returned: 0 in 0.413s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae77e51e-cf0e-41d4-92dd-16c8348a0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0730009d-e538-40bb-8076-fd7786c5c188', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cd98ef-946b-49ab-8462-d03bd55855af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:10 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Volume volume-0730009d-e538-40bb-8076-fd7786c5c188 (0730009d-e538-40bb-8076-fd7786c5c188): created successfully Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cd98ef-946b-49ab-8462-d03bd55855af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (e9ee30a1-69e3-451d-aa06-00e2d803be56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:10 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-49a8d7eb-2b32-4d32-a602-9c2ecd536186 tempest-VolumesGetTest-1105881524 None] Created volume successfully. Apr 15 23:19:10 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] GroupSnapshot ec13aaff-a4bb-4c3c-a4d6-5257331c1a08: creating. Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Group snapshot ec13aaff-a4bb-4c3c-a4d6-5257331c1a08: creating. {{(pid=82388) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Creating offline snapshot 6891af1a-2e13-4249-a0ee-8208aaba8ba7 of volume 80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4b83cd-5191-4830-a818-08afe18b4451]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:11 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb Apr 15 23:19:11 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-0730009d-e538-40bb-8076-fd7786c5c188-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Lock "cinder-0730009d-e538-40bb-8076-fd7786c5c188-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-0730009d-e538-40bb-8076-fd7786c5c188" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-0730009d-e538-40bb-8076-fd7786c5c188" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cab9df-b5f6-4516-9299-701898eb7534]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:11 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 Apr 15 23:19:11 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:11 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb" returned: 0 in 0.714s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:11 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 1G Apr 15 23:19:11 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:12 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 1G" returned: 0 in 0.539s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80459b2c-0917-4e05-840f-3afdd66ed5eb -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:12 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80459b2c-0917-4e05-840f-3afdd66ed5eb -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 Apr 15 23:19:12 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:12 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188" returned: 0 in 0.744s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:12 devstack sudo[84646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188 Apr 15 23:19:12 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:12 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80459b2c-0917-4e05-840f-3afdd66ed5eb -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7" returned: 0 in 0.482s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:12 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:12 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 Apr 15 23:19:12 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:12 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0730009d-e538-40bb-8076-fd7786c5c188" returned: 0 in 0.471s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-0730009d-e538-40bb-8076-fd7786c5c188" released by "delete_volume" :: held 1.242s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Created reservations ['1da5fd79-2cc7-469b-a9cf-e3fdbd892c7a', 'ce743216-8ce2-4496-80e6-afe13c2ffeb8', '98236fb3-53e4-4975-b38a-78734d63ae59', 'dc8944e1-5e16-41db-aa4a-416a5af38187'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:12 devstack sudo[84659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:12 devstack sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:13 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7" returned: 0 in 0.432s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:13 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.info Apr 15 23:19:13 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:13 devstack sudo[84659]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.517s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:13 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Deleted volume successfully. Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-eb3b969a-dacb-43db-a816-68f4a9cd4ed4 tempest-VolumesGetTest-1105881524 None] Lock "cinder-0730009d-e538-40bb-8076-fd7786c5c188-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:13 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.info" returned: 0 in 0.442s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:13 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:13 devstack sudo[84666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.info Apr 15 23:19:13 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-c9f4f904-f7da-4388-8568-a1abaf8b5e0b-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Lock "cinder-c9f4f904-f7da-4388-8568-a1abaf8b5e0b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-c9f4f904-f7da-4388-8568-a1abaf8b5e0b" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-c9f4f904-f7da-4388-8568-a1abaf8b5e0b" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[23477d33-a7a4-4f9c-a07d-b37d47e381c5]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:13 devstack sudo[84668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b Apr 15 23:19:13 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:14 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.info" returned: 0 in 0.618s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.292s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Creating offline snapshot 93254a68-1b73-4624-83c4-03f5efeda3f6 of volume d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9bb127-4a02-4158-b80c-e24912323b4a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:14 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 Apr 15 23:19:14 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:14 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b" returned: 0 in 0.856s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:14 devstack sudo[84703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b Apr 15 23:19:14 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:14 devstack sudo[84704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:14 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:15 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" returned: 0 in 0.885s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:15 devstack sudo[84711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 1G Apr 15 23:19:15 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:15 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9f4f904-f7da-4388-8568-a1abaf8b5e0b" returned: 0 in 0.861s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-c9f4f904-f7da-4388-8568-a1abaf8b5e0b" released by "delete_volume" :: held 1.750s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Created reservations ['d13ef687-a903-41e3-862e-81c55c0a624f', 'e6da4f0c-4e2d-465f-b4c3-c9d2aad4509f', '54153bea-7414-4b05-ae51-e1c3bc2c31da', '538aa598-b5f0-44e0-9ac4-fa22626978e2'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:15 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.993s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:15 devstack sudo[84716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:15 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:16 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 1G" returned: 0 in 1.093s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:16 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 Apr 15 23:19:16 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:16 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (8e4d0a60-eb49-4e86-9458-ab723a5ca2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed5771a-4062-4acd-b5de-5d7783870362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed5771a-4062-4acd-b5de-5d7783870362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1588755096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7f416d-6b9b-42bc-a409-cae46b44642a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:17Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f58eece-e805-4c9e-aeaa-9e4d4a55d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f58eece-e805-4c9e-aeaa-9e4d4a55d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3eb71e1-30e5-48af-ad6a-a45b8fcd56f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:17 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3eb71e1-30e5-48af-ad6a-a45b8fcd56f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7f416d-6b9b-42bc-a409-cae46b44642a', 'volume_name': 'volume-da7f416d-6b9b-42bc-a409-cae46b44642a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620a8920-ee3b-4c21-9280-9754f84a5474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620a8920-ee3b-4c21-9280-9754f84a5474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf698e95-2f96-4177-879b-3c80ef974572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:17 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Volume da7f416d-6b9b-42bc-a409-cae46b44642a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7f416d-6b9b-42bc-a409-cae46b44642a', 'volume_size': 1} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 1.407s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:17 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Deleted volume successfully. Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fc0660fc-2ed0-4ecb-a003-accef6adff74 tempest-VolumesGetTest-1105881524 None] Lock "cinder-c9f4f904-f7da-4388-8568-a1abaf8b5e0b-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:17 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6" returned: 0 in 1.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:17 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:19:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:17 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 Apr 15 23:19:17 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:18 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6" returned: 0 in 0.826s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:18 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.info Apr 15 23:19:18 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:19 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.info" returned: 0 in 0.453s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:19 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:19 devstack sudo[84752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.info Apr 15 23:19:19 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:19 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.info" returned: 0 in 0.443s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.204s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.401s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1588755096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7f416d-6b9b-42bc-a409-cae46b44642a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:17Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Creating volume da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:19 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:19 devstack sudo[84756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a 1073741824 Apr 15 23:19:19 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-beea52ee-0f90-4660-8983-15f339ab3518 tempest-GroupSnapshotsTest-1888157014 None] group_snapshot ec13aaff-a4bb-4c3c-a4d6-5257331c1a08: created successfully Apr 15 23:19:20 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a 1073741824" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:20 devstack sudo[84761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a Apr 15 23:19:20 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] group_snapshot ec13aaff-a4bb-4c3c-a4d6-5257331c1a08: deleting Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] group_snapshot ec13aaff-a4bb-4c3c-a4d6-5257331c1a08: deleting {{(pid=82388) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 23:19:20 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a" returned: 0 in 0.607s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-80459b2c-0917-4e05-840f-3afdd66ed5eb" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-80459b2c-0917-4e05-840f-3afdd66ed5eb" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-6891af1a-2e13-4249-a0ee-8208aaba8ba7" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-6891af1a-2e13-4249-a0ee-8208aaba8ba7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Deleting offline snapshot 6891af1a-2e13-4249-a0ee-8208aaba8ba7 of volume 80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] snapshot_file for this snap is: volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf698e95-2f96-4177-879b-3c80ef974572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7f416d-6b9b-42bc-a409-cae46b44642a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555d4f71-01aa-4c02-8412-fa94a4f07ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1906c8-e8de-4ffc-b841-a0e38d51fa46]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:20 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Volume volume-da7f416d-6b9b-42bc-a409-cae46b44642a (da7f416d-6b9b-42bc-a409-cae46b44642a): created successfully Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555d4f71-01aa-4c02-8412-fa94a4f07ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (8e4d0a60-eb49-4e86-9458-ab723a5ca2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-bda697be-8d6c-4540-82e4-2fb10862c575 tempest-VolumesGetTest-1105881524 None] Created volume successfully. Apr 15 23:19:20 devstack sudo[84764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 Apr 15 23:19:20 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:21 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (467c7106-ac1b-4a2a-8de9-d0e95411b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4454bd2e-cc4c-47a0-86a0-7f7f1f749271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4454bd2e-cc4c-47a0-86a0-7f7f1f749271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1179687722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c3ea65-80a3-4cfa-beb8-2b2755da8d36,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=da7f416d-6b9b-42bc-a409-cae46b44642a,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:21Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde525a4-b65d-49b6-8857-6fb123e57fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde525a4-b65d-49b6-8857-6fb123e57fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932c8ec2-cbc4-43a2-b91d-9fdf9876e260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7" returned: 0 in 0.690s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80459b2c-0917-4e05-840f-3afdd66ed5eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d15810-4ee4-45d2-8373-58e531aea573]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932c8ec2-cbc4-43a2-b91d-9fdf9876e260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '18c3ea65-80a3-4cfa-beb8-2b2755da8d36', 'volume_name': 'volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36', 'volume_size': 1, 'source_volid': 'da7f416d-6b9b-42bc-a409-cae46b44642a', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6f3855-c452-410b-baf5-dfa7dcebf28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6f3855-c452-410b-baf5-dfa7dcebf28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57800baa-6143-442a-af75-6f107cc2f29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:21 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Volume 18c3ea65-80a3-4cfa-beb8-2b2755da8d36: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36', 'volume_size': 1, 'source_volid': 'da7f416d-6b9b-42bc-a409-cae46b44642a', 'source_volstatus': 'available'} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:21 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Cloning volume da7f416d-6b9b-42bc-a409-cae46b44642a to volume 18c3ea65-80a3-4cfa-beb8-2b2755da8d36 Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Creating offline snapshot 0018cbb0-2265-4a65-8f7c-0f0ee3ac974c of volume da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eeeb4a-49cc-475a-93c6-84342f99fe7e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:21 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb Apr 15 23:19:21 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:21 devstack sudo[84778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a Apr 15 23:19:21 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:22 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb" returned: 0 in 0.783s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:22 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 Apr 15 23:19:22 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:22 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a" returned: 0 in 0.874s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:22 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c 1G Apr 15 23:19:22 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:23 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7" returned: 0 in 0.741s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:23 devstack sudo[84824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7 Apr 15 23:19:23 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:23 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c 1G" returned: 0 in 0.726s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da7f416d-6b9b-42bc-a409-cae46b44642a -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:23 devstack sudo[84827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da7f416d-6b9b-42bc-a409-cae46b44642a -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c Apr 15 23:19:23 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:23 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb.6891af1a-2e13-4249-a0ee-8208aaba8ba7" returned: 0 in 0.801s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-6891af1a-2e13-4249-a0ee-8208aaba8ba7" released by "_delete_snapshot" :: held 3.113s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-80459b2c-0917-4e05-840f-3afdd66ed5eb" released by "delete_snapshot" :: held 3.145s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-93254a68-1b73-4624-83c4-03f5efeda3f6" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-93254a68-1b73-4624-83c4-03f5efeda3f6" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Deleting offline snapshot 93254a68-1b73-4624-83c4-03f5efeda3f6 of volume d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:19:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] snapshot_file for this snap is: volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:19:24 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa575da-7e79-4ea0-90dd-a2bda07f952c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:24 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da7f416d-6b9b-42bc-a409-cae46b44642a -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" returned: 0 in 0.853s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:24 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c is being set with open permissions: ugo+rw Apr 15 23:19:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:24 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 Apr 15 23:19:24 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:24 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c Apr 15 23:19:24 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:25 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" returned: 0 in 0.879s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:25 devstack sudo[84865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.info Apr 15 23:19:25 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:25 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6" returned: 0 in 1.358s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:19:25 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[4486b544-41f3-4264-871f-e0d3d9962bc3]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:25 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 Apr 15 23:19:25 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:26 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.info" returned: 0 in 0.889s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:26 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.info is being set with open permissions: ugo+rw Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:26 devstack sudo[84875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.info Apr 15 23:19:26 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:26 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" returned: 0 in 0.854s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:26 devstack sudo[84880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 Apr 15 23:19:26 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:26 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.info" returned: 0 in 0.803s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] snapshot: 0018cbb0-2265-4a65-8f7c-0f0ee3ac974c, volume: 18c3ea65-80a3-4cfa-beb8-2b2755da8d36, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eee74b-2957-4f66-9ff8-c2ca0272fd9f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:27 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c Apr 15 23:19:27 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:27 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6" returned: 0 in 1.174s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:27 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6 Apr 15 23:19:27 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:27 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" returned: 0 in 0.953s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da7f416d-6b9b-42bc-a409-cae46b44642a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:19:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afb10a3-63b8-421b-b98f-256c975b5bb2]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:28 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a Apr 15 23:19:28 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:28 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9.93254a68-1b73-4624-83c4-03f5efeda3f6" returned: 0 in 1.015s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-93254a68-1b73-4624-83c4-03f5efeda3f6" released by "_delete_snapshot" :: held 4.597s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" released by "delete_snapshot" :: held 4.613s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:28 devstack cinder-volume[82388]: WARNING cinder.quota [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1703842720 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1703842720, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:19:28 devstack cinder-volume[82388]: WARNING cinder.quota [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1703842720 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1703842720, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['d5347096-c04c-4385-b64a-910dda22be2f', '9770e2b3-1d5c-451f-a638-a0caed2d41eb', '930e9fba-6fda-4ea7-802e-da417da5e8c0', '3a008980-4747-4049-9df1-7e3316d0f9a5'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['97d4f42e-473e-4385-9ac8-f1f8c4ffb22f', 'adfa54d6-7915-439b-b1cb-92c2c16c7c8a', 'c04c44e3-70a8-4044-a43e-c280e88fc292', 'eb0fdf9b-d96c-455d-bda6-ad24e9f99688'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-30b0c5d6-8fa3-48c4-a615-3655cee3d7fe tempest-GroupSnapshotsTest-1888157014 None] group_snapshot ec13aaff-a4bb-4c3c-a4d6-5257331c1a08: deleted successfully Apr 15 23:19:28 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a" returned: 0 in 0.984s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:19:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:29 devstack sudo[84908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 Apr 15 23:19:29 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-80459b2c-0917-4e05-840f-3afdd66ed5eb" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-80459b2c-0917-4e05-840f-3afdd66ed5eb" acquired by "delete_volume" :: waited 0.018s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcbffcc-0159-4bf4-92be-30b6de7612a1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:30 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb Apr 15 23:19:30 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:33 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb" returned: 0 in 3.229s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:33 devstack sudo[84967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb Apr 15 23:19:33 devstack sudo[84967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:33 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" returned: 0 in 4.737s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:33 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d983d4-aade-40d4-ae73-10972bf616cd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:33 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a Apr 15 23:19:33 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:34 devstack sudo[84967]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-80459b2c-0917-4e05-840f-3afdd66ed5eb" returned: 0 in 0.882s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-80459b2c-0917-4e05-840f-3afdd66ed5eb" released by "delete_volume" :: held 4.264s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:34 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7beb813-ac14-49c2-8f43-80887091920e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:34 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 Apr 15 23:19:34 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Flow 'volume_create_manager' (765825f6-9edc-4445-87aa-87fd63a5223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278a1956-7a69-4d8e-b572-bb179b0ccf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278a1956-7a69-4d8e-b572-bb179b0ccf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:35Z,deleted=False,deleted_at=None,display_description='',display_name='3132504a-5110-45ba-9e51-f20f149bd261-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73c4d30-d73f-4a34-89e2-92031463d3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cf05e45bab40949a0f9ca3a3219e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:35Z,use_quota=True,user_id='a54b4df65fb84edbb6d3fd0da6d3824b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98d72bf-b2b1-4ba2-84ea-d37dc68e16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98d72bf-b2b1-4ba2-84ea-d37dc68e16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e094d286-0459-4a08-932a-2ff2bcc4cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e094d286-0459-4a08-932a-2ff2bcc4cff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73c4d30-d73f-4a34-89e2-92031463d3dc', 'volume_name': 'volume-b73c4d30-d73f-4a34-89e2-92031463d3dc', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861d3dcd-9773-4ba2-a969-2ac307049a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861d3dcd-9773-4ba2-a969-2ac307049a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc55fc-b262-4e1a-970d-24335e0a5dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:35 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Volume b73c4d30-d73f-4a34-89e2-92031463d3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73c4d30-d73f-4a34-89e2-92031463d3dc', 'volume_size': 1} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:35 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a" returned: 0 in 1.664s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:19:35 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Converted 1024.00 MB image at 216.07 MB/s Apr 15 23:19:35 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 is being set with open permissions: ugo+rw Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:35 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 Apr 15 23:19:35 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:35 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" returned: 0 in 1.333s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:35 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9 Apr 15 23:19:35 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:36 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" returned: 0 in 0.766s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" released by "_copy_volume_from_snapshot" :: held 9.353s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Deleting offline snapshot 0018cbb0-2265-4a65-8f7c-0f0ee3ac974c of volume da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] snapshot_file for this snap is: volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f9dabc-cdb4-4ed9-9d69-9b5609b999fd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:36 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" returned: 0 in 0.901s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-d6499d99-1bed-4e49-a0ba-4c355cd3e8a9" released by "delete_volume" :: held 2.319s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:36 devstack sudo[84999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c Apr 15 23:19:36 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['ed299d53-1fc6-43aa-951c-fae78e6039fd'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:36 devstack cinder-volume[82388]: WARNING cinder.quota [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1703842720 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1703842720, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['071377b3-54f9-4781-b02c-d00e6c482784', '74a9cdc7-a23a-4621-8aae-b096921bb4fa', 'c4f3287f-3b78-4701-9c36-e8e5c49c1437', '4c85d242-9604-4acf-90f8-185681e5fd76'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['bdcdfb2e-476e-4cba-87c8-26477b92964f', '1dc3bacd-d28f-4853-84a5-e875d2fb2eed', 'b812c07c-edba-4c22-a90a-15d6bf21bbcd', 'f975ffd4-3b3e-4c20-9fcf-be44eac3a241'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:36 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:36 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:37 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" returned: 0 in 0.654s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da7f416d-6b9b-42bc-a409-cae46b44642a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:19:37 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[069df7ea-f838-4328-8f46-939e99f3bb76]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:37 devstack sudo[85008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a Apr 15 23:19:37 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:37 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.996s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:37 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:37 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-2e53d563-b761-4ae8-89b8-81ce357b713a tempest-GroupSnapshotsTest-1888157014 None] Delete group completed successfully. Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Flow 'volume_create_manager' (c668159c-285f-4e3e-aacf-b08f44713237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a1e2e1-2bcd-4141-abf9-0b0cb06d3377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ab4ecaeb-a203-4144-b72b-a9e728a5e769 tempest-GroupSnapshotsTest-1888157014 None] Group tempest-GroupSnapshotsTest-Group-459171917: creating Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a1e2e1-2bcd-4141-abf9-0b0cb06d3377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-545924517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2056c11-045d-4f22-aca3-0c4523d79bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff59c834bd54ceeba669acf6d84b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:38Z,use_quota=True,user_id='648d96997c86448f95b9e493307d091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af17cc9-de6d-4961-b8c6-62e6ef4e5797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af17cc9-de6d-4961-b8c6-62e6ef4e5797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329c1053-b919-4850-a5bb-eddafb4d54c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329c1053-b919-4850-a5bb-eddafb4d54c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2056c11-045d-4f22-aca3-0c4523d79bb7', 'volume_name': 'volume-f2056c11-045d-4f22-aca3-0c4523d79bb7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da721be-9c27-4260-8ea1-f7f708cd995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da721be-9c27-4260-8ea1-f7f708cd995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4eb584-9c80-446f-808b-a5536cd77898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:38 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Volume f2056c11-045d-4f22-aca3-0c4523d79bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2056c11-045d-4f22-aca3-0c4523d79bb7', 'volume_size': 1} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:38 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a" returned: 0 in 1.303s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:38 devstack sudo[85015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c Apr 15 23:19:38 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ab4ecaeb-a203-4144-b72b-a9e728a5e769 tempest-GroupSnapshotsTest-1888157014 None] Group tempest-GroupSnapshotsTest-Group-459171917: created successfully Apr 15 23:19:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ab4ecaeb-a203-4144-b72b-a9e728a5e769 tempest-GroupSnapshotsTest-1888157014 None] Create group completed successfully. Apr 15 23:19:39 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" returned: 0 in 0.635s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:39 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c Apr 15 23:19:39 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:39 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a.0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" returned: 0 in 0.533s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-0018cbb0-2265-4a65-8f7c-0f0ee3ac974c" released by "_delete_snapshot" :: held 3.279s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.972s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.221s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:35Z,deleted=False,deleted_at=None,display_description='',display_name='3132504a-5110-45ba-9e51-f20f149bd261-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73c4d30-d73f-4a34-89e2-92031463d3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cf05e45bab40949a0f9ca3a3219e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:35Z,use_quota=True,user_id='a54b4df65fb84edbb6d3fd0da6d3824b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Creating volume b73c4d30-d73f-4a34-89e2-92031463d3dc {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:39 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57800baa-6143-442a-af75-6f107cc2f29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36', 'volume_size': 1, 'source_volid': 'da7f416d-6b9b-42bc-a409-cae46b44642a', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb96f251-e512-4203-b394-73a386f4dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:39 devstack sudo[85028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc 1073741824 Apr 15 23:19:39 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:39 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Volume volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 (18c3ea65-80a3-4cfa-beb8-2b2755da8d36): created successfully Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb96f251-e512-4203-b394-73a386f4dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (467c7106-ac1b-4a2a-8de9-d0e95411b74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:39 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-81ebfb91-cdb6-4171-98ce-4dd3eea1f173 tempest-VolumesGetTest-1105881524 None] Created volume successfully. Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (ee3b2bf5-80ec-468f-83bd-2944c28a0be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65aecae1-3f69-4007-b4cf-ded9a0ccd6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65aecae1-3f69-4007-b4cf-ded9a0ccd6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826058806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5b9de08-2301-415e-b70c-6b529516eaac,host='devstack@QuobyteHD#QuobyteHD',id=7996f903-5482-4651-80b2-ce4b53536117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20ded1a6-d069-4941-bc94-d07c43af909c),volume_type_id=20ded1a6-d069-4941-bc94-d07c43af909c)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9340fee7-8ca4-4efa-b2ba-7c140521eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9340fee7-8ca4-4efa-b2ba-7c140521eb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477b181c-2500-4312-97db-5870ce89ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477b181c-2500-4312-97db-5870ce89ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7996f903-5482-4651-80b2-ce4b53536117', 'volume_name': 'volume-7996f903-5482-4651-80b2-ce4b53536117', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e083af4f-a801-4f69-ad30-e127f25b92d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e083af4f-a801-4f69-ad30-e127f25b92d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaaa08b-a9d2-4fdd-9441-3e82b43d34ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:39 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Volume 7996f903-5482-4651-80b2-ce4b53536117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7996f903-5482-4651-80b2-ce4b53536117', 'volume_size': 1} Apr 15 23:19:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:40 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc 1073741824" returned: 0 in 0.800s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=103,cinder:UPDATE=98,cinder:INSERT=26,cinder:DELETE=6 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:40 devstack sudo[85040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc Apr 15 23:19:40 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (378b38fe-c487-49e7-8870-ad9803192226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255531f9-2c41-4569-a750-5a51c13cd84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255531f9-2c41-4569-a750-5a51c13cd84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-145783896',display_name='tempest-VolumesGetTest-Volume-886257494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e2b7ac-8cd0-44a7-83a8-072d4e4d3569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66822596-afd0-404c-b429-ec2b30f485d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66822596-afd0-404c-b429-ec2b30f485d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122c5f69-c93c-4868-8a65-73760f94a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122c5f69-c93c-4868-8a65-73760f94a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e2b7ac-8cd0-44a7-83a8-072d4e4d3569', 'volume_name': 'volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242cae1a-5b45-4884-a0e2-89c416ae6552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242cae1a-5b45-4884-a0e2-89c416ae6552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa50f0b3-69a2-45a7-ad6d-a41a1f04f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:40 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Volume 51e2b7ac-8cd0-44a7-83a8-072d4e4d3569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569', 'volume_size': 1} Apr 15 23:19:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:41 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc" returned: 0 in 0.543s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.636s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-545924517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2056c11-045d-4f22-aca3-0c4523d79bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff59c834bd54ceeba669acf6d84b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:38Z,use_quota=True,user_id='648d96997c86448f95b9e493307d091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Creating volume f2056c11-045d-4f22-aca3-0c4523d79bb7 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:41 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afc55fc-b262-4e1a-970d-24335e0a5dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73c4d30-d73f-4a34-89e2-92031463d3dc', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3009c00-6b99-4af2-8010-a270732716e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:41 devstack sudo[85043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 1073741824 Apr 15 23:19:41 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:41 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Volume volume-b73c4d30-d73f-4a34-89e2-92031463d3dc (b73c4d30-d73f-4a34-89e2-92031463d3dc): created successfully Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3009c00-6b99-4af2-8010-a270732716e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Flow 'volume_create_manager' (765825f6-9edc-4445-87aa-87fd63a5223d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:41 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-7d83ba6f-21bb-45a7-9b43-6f3b6d826565 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Created volume successfully. Apr 15 23:19:41 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 1073741824" returned: 0 in 0.657s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:41 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 Apr 15 23:19:41 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-a6b6f2dc-cf6c-464c-81bf-fb41478c5559 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:42 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7" returned: 0 in 0.553s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.312s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c5b9de08-2301-415e-b70c-6b529516eaac,created_at=2026-04-15T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826058806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5b9de08-2301-415e-b70c-6b529516eaac,host='devstack@QuobyteHD#QuobyteHD',id=7996f903-5482-4651-80b2-ce4b53536117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9e63bc0f54448e92de80648b52ad78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='e5ce1f20ae4448f498955062ae4fa9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20ded1a6-d069-4941-bc94-d07c43af909c),volume_type_id=20ded1a6-d069-4941-bc94-d07c43af909c)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Creating volume 7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:42 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4eb584-9c80-446f-808b-a5536cd77898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2056c11-045d-4f22-aca3-0c4523d79bb7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:42 devstack sudo[85060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 1073741824 Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ca8c1f-a7a3-4275-9d18-879520840120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:42 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:42 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Volume volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 (f2056c11-045d-4f22-aca3-0c4523d79bb7): created successfully Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ca8c1f-a7a3-4275-9d18-879520840120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Flow 'volume_create_manager' (c668159c-285f-4e3e-aacf-b08f44713237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:42 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f669f240-4314-4683-bcf3-e2f3e74e63c9 tempest-ServersNegativeTestJSON-1724193868 None] Created volume successfully. Apr 15 23:19:42 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 1073741824" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:42 devstack sudo[85065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 Apr 15 23:19:42 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:43 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117" returned: 0 in 0.740s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.087s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-145783896',display_name='tempest-VolumesGetTest-Volume-886257494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e2b7ac-8cd0-44a7-83a8-072d4e4d3569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:40Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Creating volume 51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:43 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaaa08b-a9d2-4fdd-9441-3e82b43d34ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7996f903-5482-4651-80b2-ce4b53536117', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed3ec27-fddc-456a-a675-2b0afc2f0fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:43 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 1073741824 Apr 15 23:19:43 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:43 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Volume volume-7996f903-5482-4651-80b2-ce4b53536117 (7996f903-5482-4651-80b2-ce4b53536117): created successfully Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed3ec27-fddc-456a-a675-2b0afc2f0fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Flow 'volume_create_manager' (ee3b2bf5-80ec-468f-83bd-2944c28a0be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:43 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-084eed4e-e8ab-402c-a404-b7b1c1f1f875 tempest-GroupSnapshotsTest-1888157014 None] Created volume successfully. Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Flow 'volume_create_manager' (82bb209f-f3a2-4118-bdf2-f20e19984022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab1feb5-f874-4bcb-8e18-d6ef51e51dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab1feb5-f874-4bcb-8e18-d6ef51e51dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1266491184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff59c834bd54ceeba669acf6d84b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:44Z,use_quota=True,user_id='648d96997c86448f95b9e493307d091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b9a74d-747e-4e4f-b391-1c04b7be8f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b9a74d-747e-4e4f-b391-1c04b7be8f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211df16d-7313-451d-8548-e5dffa55b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211df16d-7313-451d-8548-e5dffa55b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e', 'volume_name': 'volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e63dc63-5c55-4253-80eb-20ace9ded243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e63dc63-5c55-4253-80eb-20ace9ded243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a98c73c-c098-4e08-b1db-f3eb64b0494e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:43 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Volume e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e', 'volume_size': 1} Apr 15 23:19:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:44 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 1073741824" returned: 0 in 0.662s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:44 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 Apr 15 23:19:44 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] GroupSnapshot 3d25f908-a2a0-4785-a924-c2ee97c5f2a4: creating. Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Group snapshot 3d25f908-a2a0-4785-a924-c2ee97c5f2a4: creating. {{(pid=82388) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:44 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569" returned: 0 in 0.559s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-a6b6f2dc-cf6c-464c-81bf-fb41478c5559 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.923s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa50f0b3-69a2-45a7-ad6d-a41a1f04f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a5413e-d0f7-496b-9185-b6a38415213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[357978a4-3173-434a-a752-91e8589fbef9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-a6b6f2dc-cf6c-464c-81bf-fb41478c5559 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:44 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Volume volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 (51e2b7ac-8cd0-44a7-83a8-072d4e4d3569): created successfully Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a5413e-d0f7-496b-9185-b6a38415213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (378b38fe-c487-49e7-8870-ad9803192226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-93ec11ce-3657-439c-89dc-ec84369d7da5 tempest-VolumesGetTest-1105881524 None] Created volume successfully. Apr 15 23:19:44 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc Apr 15 23:19:44 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:45 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-a6b6f2dc-cf6c-464c-81bf-fb41478c5559 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc" returned: 0 in 0.485s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-a6b6f2dc-cf6c-464c-81bf-fb41478c5559 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.506s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1266491184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff59c834bd54ceeba669acf6d84b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:44Z,use_quota=True,user_id='648d96997c86448f95b9e493307d091b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Creating volume e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:45 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:45 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e 1073741824 Apr 15 23:19:45 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-a6b6f2dc-cf6c-464c-81bf-fb41478c5559 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037', 'name': 'volume-b73c4d30-d73f-4a34-89e2-92031463d3dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8d1d4f0-ef4b-4ae6-822b-52b08e6d0a0c', 'enforce_multipath': True} {{(pid=82388) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 23:19:45 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-9a34d23b-a8d4-464f-9a62-10d66fbe907d req-a6b6f2dc-cf6c-464c-81bf-fb41478c5559 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] attachment_update completed successfully. Apr 15 23:19:45 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e 1073741824" returned: 0 in 0.522s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:46 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e Apr 15 23:19:46 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Lock "cinder-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9633aa-5036-4d65-a71e-ab68e468daae]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:46 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 Apr 15 23:19:46 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:46 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e" returned: 0 in 0.508s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.063s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a98c73c-c098-4e08-b1db-f3eb64b0494e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b991bc-03a8-4392-8b06-84454f306b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:46 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Volume volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e (e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e): created successfully Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b991bc-03a8-4392-8b06-84454f306b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Flow 'volume_create_manager' (82bb209f-f3a2-4118-bdf2-f20e19984022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Creating offline snapshot 283e0cea-a39a-4e01-8738-8b81983b9406 of volume 7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:19:46 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-418f5c87-5558-420c-ab30-5f9ba8494406 tempest-ServersNegativeTestJSON-1724193868 None] Created volume successfully. Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d4ece4-6817-4d1e-8dc8-7b30eafd1102]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:46 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:46 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 Apr 15 23:19:46 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:46 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569 Apr 15 23:19:46 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:47 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117" returned: 0 in 0.608s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:47 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 1G Apr 15 23:19:47 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:47 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569" returned: 0 in 0.582s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569" released by "delete_volume" :: held 1.139s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Created reservations ['d467a281-4ea8-4716-8705-338d1af95002', '62c8295d-86f5-46fa-8f66-fb319082f19b', '1c578385-5c35-41cc-b9c4-9a186d7f4570', 'c7896393-6ab3-43db-84ca-9dd6ef55f6c8'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:47 devstack sudo[85104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:47 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "cinder-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "cinder-quobyte-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-quobyte-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4c8829-5b5a-4e9d-acc8-1a9f352b4c84]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:47 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e Apr 15 23:19:47 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:47 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 1G" returned: 0 in 0.705s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7996f903-5482-4651-80b2-ce4b53536117 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:47 devstack sudo[85135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7996f903-5482-4651-80b2-ce4b53536117 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 Apr 15 23:19:47 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:47 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.563s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:47 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Deleted volume successfully. Apr 15 23:19:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c31845d8-fdba-45e2-b694-6f68a3f75f52 tempest-VolumesGetTest-1105881524 None] Lock "cinder-51e2b7ac-8cd0-44a7-83a8-072d4e4d3569-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:48 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e" returned: 0 in 0.570s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:48 devstack sudo[85184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e Apr 15 23:19:48 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-18c3ea65-80a3-4cfa-beb8-2b2755da8d36-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Lock "cinder-18c3ea65-80a3-4cfa-beb8-2b2755da8d36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b7a3cd-e139-404f-bbb4-71ffada99fd5]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:48 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7996f903-5482-4651-80b2-ce4b53536117 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406" returned: 0 in 0.617s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:48 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:48 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 Apr 15 23:19:48 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:48 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 Apr 15 23:19:48 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:48 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e" returned: 0 in 0.571s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-quobyte-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e" released by "delete_volume" :: held 1.184s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Created reservations ['a63ad6c0-b4f7-4083-8ab7-e1aa4b4cf645', 'b54c8aaf-5b10-4a2a-b672-f5116a9384f7', '7846129c-a207-4beb-a449-e1628db4d04c', '9ff29165-fec4-4f52-ba80-4c5f53a64d06'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:48 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:48 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:48 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406" returned: 0 in 0.485s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:49 devstack sudo[85200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.info Apr 15 23:19:49 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:49 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" returned: 0 in 0.655s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:49 devstack sudo[85205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36 Apr 15 23:19:49 devstack sudo[85205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:49 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.532s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:49 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Deleted volume successfully. Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c494423a-6040-4e6e-8e40-46e434f2e090 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-e57dcae9-5ce3-4e17-b84e-b5a8daf60b8e-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:49 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.info" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:49 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:49 devstack sudo[85209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.info Apr 15 23:19:49 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "cinder-f2056c11-045d-4f22-aca3-0c4523d79bb7-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:49 devstack sudo[85205]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-18c3ea65-80a3-4cfa-beb8-2b2755da8d36" released by "delete_volume" :: held 1.204s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-f2056c11-045d-4f22-aca3-0c4523d79bb7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "cinder-quobyte-f2056c11-045d-4f22-aca3-0c4523d79bb7" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Created reservations ['7266e2fe-80e9-4a41-9209-de6241a61528', 'fe9e3566-c1c0-4ce0-bf96-5384a49ea2d8', '2d3e2764-a187-473d-a4e1-eb31c4aeafc0', 'ee1d208f-0410-449c-8d27-045aa77f477a'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=151,cinder:SELECT=136,cinder:INSERT=28,cinder:DELETE=5 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-quobyte-f2056c11-045d-4f22-aca3-0c4523d79bb7" acquired by "delete_volume" :: waited 0.034s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee360a7a-d0b8-4efc-a387-16301bc55a01]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:49 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:49 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:49 devstack sudo[85213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 Apr 15 23:19:49 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:50 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.info" returned: 0 in 0.584s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.579s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:50 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e3e74b27-ae12-4f17-b2aa-2b0d775d5d84 tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 3d25f908-a2a0-4785-a924-c2ee97c5f2a4: created successfully Apr 15 23:19:50 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.515s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:50 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Deleted volume successfully. Apr 15 23:19:50 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-30ec7c58-bbf8-465e-a9fc-3185b3986da8 tempest-VolumesGetTest-1105881524 None] Lock "cinder-18c3ea65-80a3-4cfa-beb8-2b2755da8d36-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:50 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7 Apr 15 23:19:50 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-da7f416d-6b9b-42bc-a409-cae46b44642a-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Lock "cinder-da7f416d-6b9b-42bc-a409-cae46b44642a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-da7f416d-6b9b-42bc-a409-cae46b44642a" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-da7f416d-6b9b-42bc-a409-cae46b44642a" acquired by "delete_volume" :: waited 0.025s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e23536-ddfb-41d1-8aa3-a04c2c00a15d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:50 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 3d25f908-a2a0-4785-a924-c2ee97c5f2a4: deleting Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 3d25f908-a2a0-4785-a924-c2ee97c5f2a4: deleting {{(pid=82388) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 23:19:51 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-7996f903-5482-4651-80b2-ce4b53536117" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2056c11-045d-4f22-aca3-0c4523d79bb7" returned: 0 in 0.756s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-quobyte-f2056c11-045d-4f22-aca3-0c4523d79bb7" released by "delete_volume" :: held 1.354s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-7996f903-5482-4651-80b2-ce4b53536117" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-283e0cea-a39a-4e01-8738-8b81983b9406" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-283e0cea-a39a-4e01-8738-8b81983b9406" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:51 devstack sudo[85554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a Apr 15 23:19:51 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Deleting offline snapshot 283e0cea-a39a-4e01-8738-8b81983b9406 of volume 7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] snapshot_file for this snap is: volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe4143f-e5dd-41f2-bd59-492837b24d25]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Created reservations ['149bffb3-3f26-4bac-a2fb-591ddc1ae684', 'cc888cba-22be-4f40-8d62-dcb11f4169a9', '04fbdf14-de70-4ed4-a8f1-f49ba3330491', '6334f664-f026-46e9-b574-e4d3af81c000'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:51 devstack sudo[85566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:51 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:51 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 Apr 15 23:19:51 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:52 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a" returned: 0 in 1.282s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:52 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a Apr 15 23:19:52 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:52 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406" returned: 0 in 1.117s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7996f903-5482-4651-80b2-ce4b53536117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:19:52 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.895s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:52 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Deleted volume successfully. Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238de5a-4392-422d-bcb5-c2b7dc6a615c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a7b534f4-7e01-46f9-a228-58027a4d9401 tempest-ServersNegativeTestJSON-1724193868 None] Lock "cinder-f2056c11-045d-4f22-aca3-0c4523d79bb7-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:52 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 Apr 15 23:19:52 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:52 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-da7f416d-6b9b-42bc-a409-cae46b44642a" returned: 0 in 0.628s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-da7f416d-6b9b-42bc-a409-cae46b44642a" released by "delete_volume" :: held 1.971s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Created reservations ['e62ca8ce-09d0-4c1a-be4c-eb65980159db', '36d70c2c-170f-49ce-b136-34c1b2dacb61', 'b0a025f4-ff55-4eca-8f8b-8cb35bca43be', '89077a40-ea1a-4432-a521-b9a01ad7c492'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:52 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:52 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:52 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117" returned: 0 in 0.548s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:52 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 Apr 15 23:19:52 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:53 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.581s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:53 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Deleted volume successfully. Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5dd510d-0d5e-40f1-9f07-f5d1dee9eee1 tempest-VolumesGetTest-1105881524 None] Lock "cinder-da7f416d-6b9b-42bc-a409-cae46b44642a-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:53 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406" returned: 0 in 0.716s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:53 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406 Apr 15 23:19:53 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (cb128c47-b7bb-41ad-bc2a-2cb5a3937281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf8d33f-5483-4cce-95fb-02f9d4a75b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf8d33f-5483-4cce-95fb-02f9d4a75b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-541292022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003ac9f9-6c50-42d1-b58d-a2927a6d2370,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:54Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afd687d-f7a3-4c08-ada1-8ef25d422ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afd687d-f7a3-4c08-ada1-8ef25d422ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa81ef8c-cb85-44cc-b124-88a06d5a5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:53 devstack cinder-volume[82388]: DEBUG cinder.image.glance [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Creating Keystone auth plugin from conf {{(pid=82388) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 23:19:54 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117.283e0cea-a39a-4e01-8738-8b81983b9406" returned: 0 in 0.473s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-283e0cea-a39a-4e01-8738-8b81983b9406" released by "_delete_snapshot" :: held 3.000s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-7996f903-5482-4651-80b2-ce4b53536117" released by "delete_snapshot" :: held 3.028s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:54 devstack cinder-volume[82388]: WARNING cinder.quota [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-549638716 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-549638716, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:19:54 devstack cinder-volume[82388]: WARNING cinder.quota [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-549638716 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-549638716, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa81ef8c-cb85-44cc-b124-88a06d5a5e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '003ac9f9-6c50-42d1-b58d-a2927a6d2370', 'volume_name': 'volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106b396b-620f-413d-9920-6d1c68b3ba5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106b396b-620f-413d-9920-6d1c68b3ba5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caf0418-7690-4e9a-8825-7fb1d2f2bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:19:54 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Volume 003ac9f9-6c50-42d1-b58d-a2927a6d2370: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Trying to clone 003ac9f9-6c50-42d1-b58d-a2927a6d2370 from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]). {{(pid=82388) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['b98f5f59-63b1-4939-b696-a9b0cb44f9c1', 'a99a748c-6126-40f8-b5cd-9cbc729f56b9', 'c158e0b9-abe9-412f-a244-ffa2d76a3085', 'b3e35864-651b-4077-bdb6-6cb8aa363c21'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c291abaf-9180-4ee1-b9af-0803ad73ad35 tempest-GroupSnapshotsTest-1888157014 None] group_snapshot 3d25f908-a2a0-4785-a924-c2ee97c5f2a4: deleted successfully Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 23:19:54 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Image download 20.69 MB at 20.69 MB/s Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5318c8-248c-44f3-aa90-e36f31bbcfc4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "cinder-quobyte-7996f903-5482-4651-80b2-ce4b53536117" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:19:54 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD Apr 15 23:19:54 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-7996f903-5482-4651-80b2-ce4b53536117" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b907861-8b08-4e5a-abf9-a3abc708e361]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:54 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 Apr 15 23:19:54 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:55 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD" returned: 0 in 0.669s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 is fetched for user 24133b67aaeb42d489cfc4abe6fe8ba9. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[2137e42f-6243-4cb1-a09b-ec8239712036]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:55 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117" returned: 0 in 0.685s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:55 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD Apr 15 23:19:55 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:55 devstack sudo[85661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117 Apr 15 23:19:55 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:55 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7996f903-5482-4651-80b2-ce4b53536117" returned: 0 in 0.441s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Lock "cinder-quobyte-7996f903-5482-4651-80b2-ce4b53536117" released by "delete_volume" :: held 1.164s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['9de427e4-9442-4601-809f-3bd0eb13eca1'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:55 devstack cinder-volume[82388]: WARNING cinder.quota [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-549638716 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-549638716, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:19:55 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD" returned: 0 in 0.604s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-541292022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003ac9f9-6c50-42d1-b58d-a2927a6d2370,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:19:54Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Creating volume 003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:19:55 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Created reservations ['d8b8b13b-9370-4d95-a5f1-b98159fea2fa', '82760cd6-752a-4bb0-a3b5-4ef3aa314930', 'efb647d0-18b7-4982-8673-127c1c8f2fa0', 'e40d0c59-a6b9-4d91-a29d-7d15085710da'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:19:55 devstack sudo[85675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 1073741824 Apr 15 23:19:55 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:55 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:19:55 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:56 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 1073741824" returned: 0 in 0.542s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:56 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 Apr 15 23:19:56 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:56 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.523s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:19:56 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d9529b9d-26be-489f-98c3-65120533aad4 tempest-GroupSnapshotsTest-1888157014 None] Delete group completed successfully. Apr 15 23:19:56 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370" returned: 0 in 0.476s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Attempting download of 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume 003ac9f9-6c50-42d1-b58d-a2927a6d2370. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3922c73-f6fe-4cb7-b026-6a534eb17408]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_qtu5zosg {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:57 devstack sudo[85686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_qtu5zosg Apr 15 23:19:57 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:57 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_qtu5zosg" returned: 0 in 0.502s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_qtu5zosg {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:57 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_qtu5zosg Apr 15 23:19:57 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:58 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_qtu5zosg" returned: 1 in 0.599s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_qtu5zosg' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:19:58 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d1c92e-56f6-43d5-b098-97ae82d30e16]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:19:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:58 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD Apr 15 23:19:58 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:58 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD" returned: 0 in 0.663s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:58 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] 7964c2ec-4e08-4c1d-802c-6b54500d24d6 was qcow2, converting to raw {{(pid=82388) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 23:19:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:58 devstack sudo[85707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 Apr 15 23:19:58 devstack sudo[85707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:19:59 devstack sudo[85707]: pam_unix(sudo:session): session closed for user root Apr 15 23:19:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370" returned: 0 in 1.087s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:19:59 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_jlfsq1rvdevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:19:59 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Converted 112.00 MB image at 102.91 MB/s Apr 15 23:19:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:19:59 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 1G Apr 15 23:19:59 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:00 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 1G" returned: 0 in 0.596s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:00 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[268fb4d2-1e99-417b-80ba-3da0b9eddf78]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6d36cbd7-c499-48d5-948d-9961b4fa4f5e tempest-GroupsV314Test-1424915221 None] Group tempest-GroupsV314Test-Group-1778952809: creating Apr 15 23:20:00 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 Apr 15 23:20:00 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6d36cbd7-c499-48d5-948d-9961b4fa4f5e tempest-GroupsV314Test-1424915221 None] Group tempest-GroupsV314Test-Group-1778952809: created successfully Apr 15 23:20:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6d36cbd7-c499-48d5-948d-9961b4fa4f5e tempest-GroupsV314Test-1424915221 None] Create group completed successfully. Apr 15 23:20:00 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370" returned: 0 in 0.537s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:01 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 Apr 15 23:20:01 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:01 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370" returned: 1 in 0.508s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Downloaded image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume 003ac9f9-6c50-42d1-b58d-a2927a6d2370 successfully. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 for user 24133b67aaeb42d489cfc4abe6fe8ba9 is deleted. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Marking volume 003ac9f9-6c50-42d1-b58d-a2927a6d2370 as bootable. {{(pid=82388) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Copying metadata from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 to 003ac9f9-6c50-42d1-b58d-a2927a6d2370. {{(pid=82388) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Creating volume glance metadata for volume 003ac9f9-6c50-42d1-b58d-a2927a6d2370 backed by image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82388) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caf0418-7690-4e9a-8825-7fb1d2f2bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363b75d5-8c2c-417f-bb16-1073e1ca2c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:01 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Volume volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 (003ac9f9-6c50-42d1-b58d-a2927a6d2370): created successfully Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363b75d5-8c2c-417f-bb16-1073e1ca2c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (cb128c47-b7bb-41ad-bc2a-2cb5a3937281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a4a49261-ccac-4ec2-a9f5-ca8f047fc5a8 tempest-VolumesGetTest-1105881524 None] Created volume successfully. Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Flow 'volume_create_manager' (01de0d89-7d71-43f0-b86c-12793bf6f33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe3a5c0-4526-4ca8-907e-ffc52370717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe3a5c0-4526-4ca8-907e-ffc52370717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656227244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8c03e50-cb6e-48a4-9735-723713084fd6,host='devstack@QuobyteHD#QuobyteHD',id=59e5b609-4148-480b-a9a3-3b0aee2f2954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1cc8dbcdc04b2aa70173eddc2a5901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:02Z,use_quota=True,user_id='0d06218c58e8402ca392af1fa7870be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be2714b8-2dfc-49d3-850c-28a94f36f270),volume_type_id=be2714b8-2dfc-49d3-850c-28a94f36f270)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257c7ab9-96ea-4f0c-bdea-4ebdacae3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257c7ab9-96ea-4f0c-bdea-4ebdacae3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c50a933-fb4e-45a7-b900-c83c7c1b8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c50a933-fb4e-45a7-b900-c83c7c1b8254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e5b609-4148-480b-a9a3-3b0aee2f2954', 'volume_name': 'volume-59e5b609-4148-480b-a9a3-3b0aee2f2954', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265671a8-b7e0-4f77-9007-a5800f28aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265671a8-b7e0-4f77-9007-a5800f28aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525722b0-9adb-421f-a6fc-9b2adc96c637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:01 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Volume 59e5b609-4148-480b-a9a3-3b0aee2f2954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e5b609-4148-480b-a9a3-3b0aee2f2954', 'volume_size': 1} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f8c03e50-cb6e-48a4-9735-723713084fd6,created_at=2026-04-15T21:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656227244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8c03e50-cb6e-48a4-9735-723713084fd6,host='devstack@QuobyteHD#QuobyteHD',id=59e5b609-4148-480b-a9a3-3b0aee2f2954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1cc8dbcdc04b2aa70173eddc2a5901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:02Z,use_quota=True,user_id='0d06218c58e8402ca392af1fa7870be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be2714b8-2dfc-49d3-850c-28a94f36f270),volume_type_id=be2714b8-2dfc-49d3-850c-28a94f36f270)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Creating volume 59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:01 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:01 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 1073741824 Apr 15 23:20:01 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:02 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 1073741824" returned: 0 in 0.587s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:02 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 Apr 15 23:20:02 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (1c77d4ae-51df-45e5-adc0-b2aa60c1f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bf7097-1dec-484e-9318-4c6514962855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6bf7097-1dec-484e-9318-4c6514962855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-32998748',display_name='tempest-VolumesGetTest-Volume-104030121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0b9116-6aa0-4831-aeac-ae74d5cd845e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:03Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fd801b-3894-4bb3-920e-bdea2d79e97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fd801b-3894-4bb3-920e-bdea2d79e97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499b6709-01ab-4be5-b5e8-2f22b48f916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499b6709-01ab-4be5-b5e8-2f22b48f916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0b9116-6aa0-4831-aeac-ae74d5cd845e', 'volume_name': 'volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce7ca9f-9af1-432c-9f72-a552072d4a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce7ca9f-9af1-432c-9f72-a552072d4a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ce35cc-bbe0-40a3-8298-aa24be19dff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:03 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Volume 9d0b9116-6aa0-4831-aeac-ae74d5cd845e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e', 'volume_size': 1} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:03 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954" returned: 0 in 0.571s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-32998748',display_name='tempest-VolumesGetTest-Volume-104030121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0b9116-6aa0-4831-aeac-ae74d5cd845e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fedd85520ca4207a0079822dfffaa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:03Z,use_quota=True,user_id='24133b67aaeb42d489cfc4abe6fe8ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Creating volume 9d0b9116-6aa0-4831-aeac-ae74d5cd845e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:03 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525722b0-9adb-421f-a6fc-9b2adc96c637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e5b609-4148-480b-a9a3-3b0aee2f2954', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ad311d-e4d5-4d1a-beb6-279b10f2c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:03 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e 1073741824 Apr 15 23:20:03 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:03 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Volume volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 (59e5b609-4148-480b-a9a3-3b0aee2f2954): created successfully Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ad311d-e4d5-4d1a-beb6-279b10f2c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Flow 'volume_create_manager' (01de0d89-7d71-43f0-b86c-12793bf6f33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:03 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-39984066-b0d1-4d94-aed7-9b9548578c79 tempest-GroupsV314Test-1424915221 None] Created volume successfully. Apr 15 23:20:03 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e 1073741824" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:03 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e Apr 15 23:20:03 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:04 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e" returned: 0 in 0.539s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ce35cc-bbe0-40a3-8298-aa24be19dff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94a7f6c-8d8b-4b26-a1a0-ca3cfc2631d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:04 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Volume volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e (9d0b9116-6aa0-4831-aeac-ae74d5cd845e): created successfully Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94a7f6c-8d8b-4b26-a1a0-ca3cfc2631d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Flow 'volume_create_manager' (1c77d4ae-51df-45e5-adc0-b2aa60c1f382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:04 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c9940a29-99e3-41c9-8917-ed511d488871 tempest-VolumesGetTest-1105881524 None] Created volume successfully. Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:04 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Cloning volume 59e5b609-4148-480b-a9a3-3b0aee2f2954 to volume bc077698-4054-469f-97fe-f63fa980b0b7 Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Creating offline snapshot 6cd92444-801e-40a5-b2bb-f4bda4782618 of volume 59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[085bc5d5-21e2-49bb-8b9c-aaa78459fb6b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:05 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 Apr 15 23:20:05 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-9d0b9116-6aa0-4831-aeac-ae74d5cd845e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Lock "cinder-9d0b9116-6aa0-4831-aeac-ae74d5cd845e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-9d0b9116-6aa0-4831-aeac-ae74d5cd845e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-9d0b9116-6aa0-4831-aeac-ae74d5cd845e" acquired by "delete_volume" :: waited 0.022s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e640fb0-07ba-49f3-bfd1-af8bd4e999eb]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:05 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e Apr 15 23:20:05 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-832487b8-54f3-4daa-8e37-47af7f517c45 tempest-GroupsTest-118205323 None] Group tempest-Group1-1368986000: creating Apr 15 23:20:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-832487b8-54f3-4daa-8e37-47af7f517c45 tempest-GroupsTest-118205323 None] Group tempest-Group1-1368986000: created successfully Apr 15 23:20:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-832487b8-54f3-4daa-8e37-47af7f517c45 tempest-GroupsTest-118205323 None] Create group completed successfully. Apr 15 23:20:05 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954" returned: 0 in 0.908s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:05 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 1G Apr 15 23:20:05 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:06 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e" returned: 0 in 0.709s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:06 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e Apr 15 23:20:06 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:06 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 1G" returned: 0 in 0.554s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:06 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 Apr 15 23:20:06 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:06 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9d0b9116-6aa0-4831-aeac-ae74d5cd845e" returned: 0 in 0.500s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-9d0b9116-6aa0-4831-aeac-ae74d5cd845e" released by "delete_volume" :: held 1.298s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:06 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Created reservations ['54da2c07-5278-4ca1-b65a-1708fcdf6851', '1b3810f5-4233-4119-91a7-e152584685e0', '9f057b8a-0690-455c-82f1-cf7df2c20b03', 'd6566fc3-f303-4623-8d76-e5f8225d9560'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:07 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:07 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:07 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618" returned: 0 in 0.562s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:07 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:07 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 Apr 15 23:20:07 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-50f27676-4b33-4b6c-888d-c23fb9e1ddf3 tempest-GroupsTest-118205323 None] Group tempest-Group2-1764049686: creating Apr 15 23:20:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-50f27676-4b33-4b6c-888d-c23fb9e1ddf3 tempest-GroupsTest-118205323 None] Group tempest-Group2-1764049686: created successfully Apr 15 23:20:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-50f27676-4b33-4b6c-888d-c23fb9e1ddf3 tempest-GroupsTest-118205323 None] Create group completed successfully. Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-003ac9f9-6c50-42d1-b58d-a2927a6d2370-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:07 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618" returned: 0 in 0.583s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Lock "cinder-003ac9f9-6c50-42d1-b58d-a2927a6d2370-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:07 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.665s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Deleted volume successfully. Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Acquiring lock "cinder-quobyte-003ac9f9-6c50-42d1-b58d-a2927a6d2370" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9873621a-33c8-4ece-aead-eece8c7a7c68 tempest-VolumesGetTest-1105881524 None] Lock "cinder-9d0b9116-6aa0-4831-aeac-ae74d5cd845e-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:07 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.info Apr 15 23:20:07 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-003ac9f9-6c50-42d1-b58d-a2927a6d2370" acquired by "delete_volume" :: waited 0.028s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e12738-6477-4e6b-8ef4-f8dccdb9378b]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:07 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 Apr 15 23:20:07 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:08 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.info" returned: 0 in 0.452s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:08 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:08 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.info Apr 15 23:20:08 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:08 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370" returned: 0 in 0.591s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:08 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 Apr 15 23:20:08 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Flow 'volume_create_manager' (9c8ab1c5-92f1-4a04-9cd2-12109fe6214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56ace7f-7249-4de6-b58f-6c6115157789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:08 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56ace7f-7249-4de6-b58f-6c6115157789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1341655333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89fea0f4-a392-420c-88ae-7f8167646271,host='devstack@QuobyteHD#QuobyteHD',id=17e48026-c0a4-4489-a62a-dd242f0b335a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e3aba1d97341eaa9f48767d8195030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:09Z,use_quota=True,user_id='9eb5d026c88e4161b203d23fad9e1eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54bccd8e-e92d-46a4-ad1f-42084df4085b),volume_type_id=54bccd8e-e92d-46a4-ad1f-42084df4085b)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f3da8a-2c83-4d80-8c9b-613cd7f57cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f3da8a-2c83-4d80-8c9b-613cd7f57cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87db4fd-b1ac-472c-9f4b-8aebbef651ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87db4fd-b1ac-472c-9f4b-8aebbef651ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e48026-c0a4-4489-a62a-dd242f0b335a', 'volume_name': 'volume-17e48026-c0a4-4489-a62a-dd242f0b335a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301c8bd1-085e-40ef-b4bb-81d07c118828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301c8bd1-085e-40ef-b4bb-81d07c118828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa78f4b-58d5-496d-8f2e-809e0bdeac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:08 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Volume 17e48026-c0a4-4489-a62a-dd242f0b335a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e48026-c0a4-4489-a62a-dd242f0b335a', 'volume_size': 1} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.info" returned: 0 in 0.556s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Acquiring lock "cinder-quobyte-bc077698-4054-469f-97fe-f63fa980b0b7" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-bc077698-4054-469f-97fe-f63fa980b0b7" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] snapshot: 6cd92444-801e-40a5-b2bb-f4bda4782618, volume: bc077698-4054-469f-97fe-f63fa980b0b7, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[44152732-dce4-48f1-a328-7e48bb47d149]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:08 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 Apr 15 23:20:08 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:09 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370" returned: 1 in 0.814s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:09 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370 Apr 15 23:20:09 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:09 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618" returned: 0 in 0.485s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59e5b609-4148-480b-a9a3-3b0aee2f2954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[343595b2-ee33-447a-8808-e76befbe709b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:09 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 Apr 15 23:20:09 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:09 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-003ac9f9-6c50-42d1-b58d-a2927a6d2370" returned: 0 in 0.414s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Lock "cinder-quobyte-003ac9f9-6c50-42d1-b58d-a2927a6d2370" released by "delete_volume" :: held 1.862s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Created reservations ['7e8dc5ed-c734-471b-b385-1518d70cc3f3', '97e16f7d-f5ae-48dc-b60b-6872832d4e0d', '6ede90b2-9bc6-48aa-97c3-1855e522eba7', '7deb8113-0ac0-40d4-9d0a-d819322aae0d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:09 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:09 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:09 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954" returned: 0 in 0.533s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:20:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:09 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 Apr 15 23:20:09 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:10 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.648s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:10 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:10 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Deleted volume successfully. Apr 15 23:20:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c0d66ec1-19f7-4f85-b53f-32ed6af597c7 tempest-VolumesGetTest-1105881524 None] Lock "cinder-003ac9f9-6c50-42d1-b58d-a2927a6d2370-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:12 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7" returned: 0 in 3.083s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:12 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de5d84-3863-4b02-8ab5-e310bafd5b18]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:13 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 Apr 15 23:20:13 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (7b18c8fd-5bee-4524-a646-3bfb1c31db97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d967f767-329f-463a-8146-43c8d3e25062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d967f767-329f-463a-8146-43c8d3e25062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-342206686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53109b03-1d41-43b8-b596-819065c40bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4b8e99-de6b-4ae8-a52f-fd2f3ff538c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4b8e99-de6b-4ae8-a52f-fd2f3ff538c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba51992-e6ba-4892-bf25-4d970b014fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba51992-e6ba-4892-bf25-4d970b014fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53109b03-1d41-43b8-b596-819065c40bd8', 'volume_name': 'volume-53109b03-1d41-43b8-b596-819065c40bd8', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6974c245-6336-4490-a9fe-9739d9f26f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6974c245-6336-4490-a9fe-9739d9f26f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d43b01e-c1b5-45b7-a60e-92c7a0203631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Volume 53109b03-1d41-43b8-b596-819065c40bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53109b03-1d41-43b8-b596-819065c40bd8', 'volume_size': 1} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:13 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954" returned: 0 in 0.752s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954, size 1024.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:20:13 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Converted 1024.00 MB image at 332.09 MB/s Apr 15 23:20:13 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:13 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 Apr 15 23:20:13 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (2322aacb-60f8-45d7-a252-32913e607cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795a44ba-bbb6-4a36-8144-f7f19af9a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795a44ba-bbb6-4a36-8144-f7f19af9a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1227681674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0bfb1a-e966-4708-86da-e85b38785ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1955efc2-38e2-41d7-b965-280f01900815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1955efc2-38e2-41d7-b965-280f01900815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ba6305-54eb-4760-9a83-c69342616c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ba6305-54eb-4760-9a83-c69342616c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0bfb1a-e966-4708-86da-e85b38785ac4', 'volume_name': 'volume-bf0bfb1a-e966-4708-86da-e85b38785ac4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6325f0-92ef-44c8-81e4-2074c18d1dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6325f0-92ef-44c8-81e4-2074c18d1dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a98879-93e0-442c-8de6-047497da51cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:13 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Volume bf0bfb1a-e966-4708-86da-e85b38785ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0bfb1a-e966-4708-86da-e85b38785ac4', 'volume_size': 1} Apr 15 23:20:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (8e782446-1ec7-450f-92e8-45ec03a28fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e05adc-39b0-45ff-a3b9-bedb0aecf735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e05adc-39b0-45ff-a3b9-bedb0aecf735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768098140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d508e73-6bc0-4583-87c1-f32aa9de8e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5abf31d-4be6-4539-a617-fdfc8a4be93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5abf31d-4be6-4539-a617-fdfc8a4be93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df32ffe0-5253-4ad4-b169-a2af748386ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df32ffe0-5253-4ad4-b169-a2af748386ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d508e73-6bc0-4583-87c1-f32aa9de8e50', 'volume_name': 'volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cfdd84-39ac-435b-a7e2-1453e8e1ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cfdd84-39ac-435b-a7e2-1453e8e1ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71141c97-82a2-47b8-8a38-6378735f4ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Volume 4d508e73-6bc0-4583-87c1-f32aa9de8e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50', 'volume_size': 1} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:14 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (9fc24468-56c2-4505-89f3-f465d97cc9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5365a5-5b60-40b1-8973-23a4a2325201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-bc077698-4054-469f-97fe-f63fa980b0b7" released by "_copy_volume_from_snapshot" :: held 5.572s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5365a5-5b60-40b1-8973-23a4a2325201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819831578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33748950-f64f-4d34-a7b7-c090fa6f4e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e644f8-6271-4324-82c9-146edb889ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e644f8-6271-4324-82c9-146edb889ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e2d448-ac46-4c55-afb3-c4a54b6aeab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e2d448-ac46-4c55-afb3-c4a54b6aeab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33748950-f64f-4d34-a7b7-c090fa6f4e5f', 'volume_name': 'volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a233de3-9a8a-4c4d-9e6e-f54aa84504a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a233de3-9a8a-4c4d-9e6e-f54aa84504a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3255ed9-eea1-44c7-9da2-a28f1ae7c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Volume 33748950-f64f-4d34-a7b7-c090fa6f4e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f', 'volume_size': 1} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Acquiring lock "cinder-quobyte-6cd92444-801e-40a5-b2bb-f4bda4782618" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-6cd92444-801e-40a5-b2bb-f4bda4782618" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Deleting offline snapshot 6cd92444-801e-40a5-b2bb-f4bda4782618 of volume 59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] snapshot_file for this snap is: volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fccfab-aafb-4568-b021-a21072534279]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (a1054f0f-9fd4-4c90-9c4c-fcbfa68a0d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9361c3c3-9bff-409f-b0f7-f2c2438e20a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 Apr 15 23:20:14 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9361c3c3-9bff-409f-b0f7-f2c2438e20a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104281075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486cc078-75fc-48f5-aa96-1726c1beb76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8da29c-3db4-456c-9425-5141988e315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8da29c-3db4-456c-9425-5141988e315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be503954-655b-45b5-8704-e19472d9cc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be503954-655b-45b5-8704-e19472d9cc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486cc078-75fc-48f5-aa96-1726c1beb76a', 'volume_name': 'volume-486cc078-75fc-48f5-aa96-1726c1beb76a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bb022a-9167-4034-b9c6-ef294dc10f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bb022a-9167-4034-b9c6-ef294dc10f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09ca7c7-d4e1-4753-9aab-fce77cfb41d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Volume 486cc078-75fc-48f5-aa96-1726c1beb76a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486cc078-75fc-48f5-aa96-1726c1beb76a', 'volume_size': 1} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:14 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:14 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:14 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618" returned: 0 in 0.514s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59e5b609-4148-480b-a9a3-3b0aee2f2954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb57cd7-4845-4a79-988f-31314fe3fd20]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:15 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 Apr 15 23:20:15 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:15 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:15 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:15 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 Apr 15 23:20:15 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:16 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618" returned: 0 in 0.519s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:16 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618 Apr 15 23:20:16 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:16 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954.6cd92444-801e-40a5-b2bb-f4bda4782618" returned: 0 in 0.467s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-6cd92444-801e-40a5-b2bb-f4bda4782618" released by "_delete_snapshot" :: held 2.101s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.575s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.794s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89fea0f4-a392-420c-88ae-7f8167646271,created_at=2026-04-15T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1341655333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89fea0f4-a392-420c-88ae-7f8167646271,host='devstack@QuobyteHD#QuobyteHD',id=17e48026-c0a4-4489-a62a-dd242f0b335a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e3aba1d97341eaa9f48767d8195030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:09Z,use_quota=True,user_id='9eb5d026c88e4161b203d23fad9e1eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54bccd8e-e92d-46a4-ad1f-42084df4085b),volume_type_id=54bccd8e-e92d-46a4-ad1f-42084df4085b)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Creating volume 17e48026-c0a4-4489-a62a-dd242f0b335a {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:16 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:16 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a 1073741824 Apr 15 23:20:16 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:16 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f77538be-7f86-4796-bf97-b91cd2d8508a tempest-GroupsV314Test-1424915221 None] Create group from source-group-f8c03e50-cb6e-48a4-9735-723713084fd6 completed successfully. Apr 15 23:20:17 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a 1073741824" returned: 0 in 0.570s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:17 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a Apr 15 23:20:17 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:17 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a" returned: 0 in 0.448s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.896s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-342206686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53109b03-1d41-43b8-b596-819065c40bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Creating volume 53109b03-1d41-43b8-b596-819065c40bd8 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:17 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa78f4b-58d5-496d-8f2e-809e0bdeac6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e48026-c0a4-4489-a62a-dd242f0b335a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:17 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 1073741824 Apr 15 23:20:17 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f8aaf-aa8b-4f66-8394-ecb518773c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:17 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Volume volume-17e48026-c0a4-4489-a62a-dd242f0b335a (17e48026-c0a4-4489-a62a-dd242f0b335a): created successfully Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f8aaf-aa8b-4f66-8394-ecb518773c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Flow 'volume_create_manager' (9c8ab1c5-92f1-4a04-9cd2-12109fe6214e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:17 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-9056827c-83a3-4b78-b46e-548f27f9d5a3 tempest-GroupsTest-118205323 None] Created volume successfully. Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Acquiring lock "cinder-quobyte-bc077698-4054-469f-97fe-f63fa980b0b7" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-bc077698-4054-469f-97fe-f63fa980b0b7" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c32253-58b4-4cc6-bbd0-32e8525569ce]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:17 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 Apr 15 23:20:17 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Acquiring lock "cinder-quobyte-17e48026-c0a4-4489-a62a-dd242f0b335a" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Lock "cinder-quobyte-17e48026-c0a4-4489-a62a-dd242f0b335a" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c122eb4-a266-4c62-b3a4-799ce044b3ad]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:18 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a Apr 15 23:20:18 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:18 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 1073741824" returned: 0 in 0.691s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:18 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 Apr 15 23:20:18 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:18 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7" returned: 0 in 0.621s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:18 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7 Apr 15 23:20:18 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:18 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a" returned: 0 in 0.653s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:18 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a Apr 15 23:20:18 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:18 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8" returned: 0 in 0.567s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.964s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1227681674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0bfb1a-e966-4708-86da-e85b38785ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Creating volume bf0bfb1a-e966-4708-86da-e85b38785ac4 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:18 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d43b01e-c1b5-45b7-a60e-92c7a0203631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53109b03-1d41-43b8-b596-819065c40bd8', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c55761-1388-4735-ae5c-62da7db9625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:18 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Volume volume-53109b03-1d41-43b8-b596-819065c40bd8 (53109b03-1d41-43b8-b596-819065c40bd8): created successfully Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c55761-1388-4735-ae5c-62da7db9625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (7b18c8fd-5bee-4524-a646-3bfb1c31db97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:18 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 1073741824 Apr 15 23:20:18 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c70df5a2-ca1f-4d57-b442-1857928d1456 tempest-CreateVolumesFromImageTest-537211574 None] Created volume successfully. Apr 15 23:20:19 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bc077698-4054-469f-97fe-f63fa980b0b7" returned: 0 in 0.587s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-bc077698-4054-469f-97fe-f63fa980b0b7" released by "delete_volume" :: held 1.235s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Created reservations ['a5998004-3022-4270-9406-19596e3ebdb6'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:19 devstack cinder-volume[82388]: WARNING cinder.quota [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1745738302 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1745738302, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:20:19 devstack cinder-volume[82388]: WARNING cinder.quota [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1745738302 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1745738302, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Created reservations ['b44d8cf3-604c-4170-b986-ef5d6685f9c3', 'af25a702-ca4d-4e5c-bc5c-7296e38aa952', 'add2533e-7573-4bf6-90f2-26c13a6cb429', '4851e96e-9f43-456d-b4aa-f23c1b6074c6'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:19 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:19 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:19 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-17e48026-c0a4-4489-a62a-dd242f0b335a" returned: 0 in 0.666s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Lock "cinder-quobyte-17e48026-c0a4-4489-a62a-dd242f0b335a" released by "delete_volume" :: held 1.347s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Created reservations ['acb960cc-b989-42a8-aeea-88ce5193f3c0'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:19 devstack cinder-volume[82388]: WARNING cinder.quota [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2044598388 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2044598388, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:20:19 devstack cinder-volume[82388]: WARNING cinder.quota [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2044598388 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2044598388, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Created reservations ['20285703-87ce-4223-98e1-aded1e2379a3', '3fc3582b-b4cd-42f1-9c77-56a5e49e5c4d', '676e584d-b2d4-483d-bf41-b70179cb143b', 'd3048ddc-2afd-4af3-9207-345daa237edb'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:19 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:19 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:19 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 1073741824" returned: 0 in 0.771s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:19 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 Apr 15 23:20:19 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:19 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.573s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:19 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-73329ec3-af1e-438f-b554-4f9093ed14f4 tempest-GroupsV314Test-1424915221 None] Delete group completed successfully. Apr 15 23:20:20 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4" returned: 0 in 0.448s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.016s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768098140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d508e73-6bc0-4583-87c1-f32aa9de8e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Creating volume 4d508e73-6bc0-4583-87c1-f32aa9de8e50 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:20 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:20 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.536s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:20 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 1073741824 Apr 15 23:20:20 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a98879-93e0-442c-8de6-047497da51cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0bfb1a-e966-4708-86da-e85b38785ac4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e46168-8cf6-4116-8015-cf05d18f99dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a4cad6ad-64b8-4eef-971d-a989732a55d9 tempest-GroupsTest-118205323 None] Delete group completed successfully. Apr 15 23:20:20 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Volume volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 (bf0bfb1a-e966-4708-86da-e85b38785ac4): created successfully Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e46168-8cf6-4116-8015-cf05d18f99dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (2322aacb-60f8-45d7-a252-32913e607cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-925612ef-3c4e-416c-8d7f-117eff7071a1 tempest-CreateVolumesFromImageTest-537211574 None] Created volume successfully. Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Acquiring lock "cinder-quobyte-59e5b609-4148-480b-a9a3-3b0aee2f2954" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-59e5b609-4148-480b-a9a3-3b0aee2f2954" acquired by "delete_volume" :: waited 0.023s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff4d6b-bad5-47f3-8b5f-5b21c8c0f804]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:20 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 Apr 15 23:20:20 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Created reservations ['1a8713f6-901c-4216-af72-b2a20f011852'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:20 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:20 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:20 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 1073741824" returned: 0 in 0.663s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:20 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954" returned: 0 in 0.584s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:20 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954 Apr 15 23:20:20 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:20 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 Apr 15 23:20:20 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:21 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.514s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:21 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-13137f40-e7b4-40e8-bd96-d2c74073973d tempest-GroupsTest-118205323 None] Delete group completed successfully. Apr 15 23:20:21 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-59e5b609-4148-480b-a9a3-3b0aee2f2954" returned: 0 in 0.425s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Lock "cinder-quobyte-59e5b609-4148-480b-a9a3-3b0aee2f2954" released by "delete_volume" :: held 1.042s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:21 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50" returned: 0 in 0.445s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.938s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819831578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33748950-f64f-4d34-a7b7-c090fa6f4e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Creating volume 33748950-f64f-4d34-a7b7-c090fa6f4e5f {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:21 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71141c97-82a2-47b8-8a38-6378735f4ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4a8d79-49d1-4220-9a3d-f519582c86a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:21 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f 1073741824 Apr 15 23:20:21 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:21 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Volume volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 (4d508e73-6bc0-4583-87c1-f32aa9de8e50): created successfully Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4a8d79-49d1-4220-9a3d-f519582c86a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (8e782446-1ec7-450f-92e8-45ec03a28fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:21 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e435b207-c807-4f71-b72f-8856b8bfa08b tempest-CreateVolumesFromImageTest-537211574 None] Created volume successfully. Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Created reservations ['6c64af62-5961-4ec5-86e4-806d5130c318'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Created reservations ['ce11e83b-da67-4695-b58f-c2fca378d00b', '5a4de743-3b0e-4511-8da8-3236dafdac8b', 'b013319f-5770-4153-9dce-d24d95f44825', '46d1ceb9-671e-42ed-859c-b410727e91f3'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:21 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:21 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:21 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-090f4d0f-5f3c-41fc-93bf-2785da78b03d tempest-GroupsTest-118205323 None] Group tempest-GroupsTest-Group-282077918: creating Apr 15 23:20:21 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-090f4d0f-5f3c-41fc-93bf-2785da78b03d tempest-GroupsTest-118205323 None] Group tempest-GroupsTest-Group-282077918: created successfully Apr 15 23:20:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-090f4d0f-5f3c-41fc-93bf-2785da78b03d tempest-GroupsTest-118205323 None] Create group completed successfully. Apr 15 23:20:22 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f 1073741824" returned: 0 in 0.689s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:22 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.558s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-334bafd6-7cd4-4274-b690-835bb4adea7b tempest-GroupsV314Test-1424915221 None] Delete group completed successfully. Apr 15 23:20:22 devstack sudo[86162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f Apr 15 23:20:22 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:22 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f" returned: 0 in 0.437s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.941s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104281075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486cc078-75fc-48f5-aa96-1726c1beb76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022cbab046eb4558816bb5be31191650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:14Z,use_quota=True,user_id='5fcff4d9564a4eaab6aeaf30372d7a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Creating volume 486cc078-75fc-48f5-aa96-1726c1beb76a {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:22 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3255ed9-eea1-44c7-9da2-a28f1ae7c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a24f32-88dd-490f-985b-c758b116a7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:22 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a 1073741824 Apr 15 23:20:22 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:22 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Volume volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f (33748950-f64f-4d34-a7b7-c090fa6f4e5f): created successfully Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a24f32-88dd-490f-985b-c758b116a7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (9fc24468-56c2-4505-89f3-f465d97cc9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b5ac680c-bada-4e92-b69b-1c8fbc97a6b8 tempest-CreateVolumesFromImageTest-537211574 None] Created volume successfully. Apr 15 23:20:23 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a 1073741824" returned: 0 in 0.622s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:23 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a Apr 15 23:20:23 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Flow 'volume_create_manager' (ddbd1988-2387-4ca0-8f97-9a4e9c6d21bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae572f1-6f32-43b1-9115-09b839354039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae572f1-6f32-43b1-9115-09b839354039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266866458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86be36ec-9013-429a-90bc-425f191b09d1,host='devstack@QuobyteHD#QuobyteHD',id=6e0d7d63-b1cd-44ee-8acf-617e4a873957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e3aba1d97341eaa9f48767d8195030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:23Z,use_quota=True,user_id='9eb5d026c88e4161b203d23fad9e1eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c669ff4-f55e-4ccd-98d6-6d23b890e6a0),volume_type_id=6c669ff4-f55e-4ccd-98d6-6d23b890e6a0)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8949622-77be-4673-897d-99cc7bde33b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8949622-77be-4673-897d-99cc7bde33b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28334952-3484-4ead-bcf2-90bd50d539f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28334952-3484-4ead-bcf2-90bd50d539f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0d7d63-b1cd-44ee-8acf-617e4a873957', 'volume_name': 'volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddd5d1a-19a9-4bd0-a933-eae08fdfa69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddd5d1a-19a9-4bd0-a933-eae08fdfa69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024bb5d1-b4f8-49e4-a09f-5c8145f4d1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:23 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Volume 6e0d7d63-b1cd-44ee-8acf-617e4a873957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957', 'volume_size': 1} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:23 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a" returned: 0 in 0.550s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.256s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86be36ec-9013-429a-90bc-425f191b09d1,created_at=2026-04-15T21:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266866458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86be36ec-9013-429a-90bc-425f191b09d1,host='devstack@QuobyteHD#QuobyteHD',id=6e0d7d63-b1cd-44ee-8acf-617e4a873957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e3aba1d97341eaa9f48767d8195030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:23Z,use_quota=True,user_id='9eb5d026c88e4161b203d23fad9e1eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c669ff4-f55e-4ccd-98d6-6d23b890e6a0),volume_type_id=6c669ff4-f55e-4ccd-98d6-6d23b890e6a0)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Creating volume 6e0d7d63-b1cd-44ee-8acf-617e4a873957 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:23 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09ca7c7-d4e1-4753-9aab-fce77cfb41d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486cc078-75fc-48f5-aa96-1726c1beb76a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fea70b-5176-42c9-a270-3dc71e23e45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:23 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 1073741824 Apr 15 23:20:23 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:23 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Volume volume-486cc078-75fc-48f5-aa96-1726c1beb76a (486cc078-75fc-48f5-aa96-1726c1beb76a): created successfully Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fea70b-5176-42c9-a270-3dc71e23e45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Flow 'volume_create_manager' (a1054f0f-9fd4-4c90-9c4c-fcbfa68a0d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:23 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-778fc520-117b-4aa7-86a3-5c7d9f12edf2 tempest-CreateVolumesFromImageTest-537211574 None] Created volume successfully. Apr 15 23:20:24 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 1073741824" returned: 0 in 0.527s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-486cc078-75fc-48f5-aa96-1726c1beb76a-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:24 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 Apr 15 23:20:24 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-486cc078-75fc-48f5-aa96-1726c1beb76a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-quobyte-486cc078-75fc-48f5-aa96-1726c1beb76a" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-486cc078-75fc-48f5-aa96-1726c1beb76a" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e034c537-3bbd-4ff3-9b32-36578e5290de]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:24 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a Apr 15 23:20:24 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:24 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957" returned: 0 in 0.593s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024bb5d1-b4f8-49e4-a09f-5c8145f4d1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faa79c8-7799-4714-a4e2-8a290c541c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:24 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Volume volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 (6e0d7d63-b1cd-44ee-8acf-617e4a873957): created successfully Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faa79c8-7799-4714-a4e2-8a290c541c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Flow 'volume_create_manager' (ddbd1988-2387-4ca0-8f97-9a4e9c6d21bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:24 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c65b8a96-1ea7-491d-88df-3017a3ca70df tempest-GroupsTest-118205323 None] Created volume successfully. Apr 15 23:20:25 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a" returned: 0 in 0.898s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:25 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a Apr 15 23:20:25 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:25 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-486cc078-75fc-48f5-aa96-1726c1beb76a" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-486cc078-75fc-48f5-aa96-1726c1beb76a" released by "delete_volume" :: held 1.538s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:25 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Created reservations ['2b949c5b-da47-4c37-bdc8-7a96e478431e', 'eddefca3-49c5-4ea5-bef2-0d3c60fa262c', '8e151f38-6559-429c-a5e7-f5da3d0a2a06', '77de099a-7c20-44b4-9e32-4d424f921ecd'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:26 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:26 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Flow 'volume_create_manager' (f62dddff-58d8-449f-a7e9-41845f9f1bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3470c95-3a72-49b7-8590-4c4fe8e3e5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3470c95-3a72-49b7-8590-4c4fe8e3e5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705734757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86be36ec-9013-429a-90bc-425f191b09d1,host='devstack@QuobyteHD#QuobyteHD',id=b1653ac4-07d0-4053-97aa-6cbd81fe819e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e3aba1d97341eaa9f48767d8195030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:26Z,use_quota=True,user_id='9eb5d026c88e4161b203d23fad9e1eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c669ff4-f55e-4ccd-98d6-6d23b890e6a0),volume_type_id=6c669ff4-f55e-4ccd-98d6-6d23b890e6a0)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95689cb-eef5-453a-ad92-be7b4c625aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95689cb-eef5-453a-ad92-be7b4c625aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c825f4ee-7a8c-43c8-b21f-3db389262637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c825f4ee-7a8c-43c8-b21f-3db389262637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1653ac4-07d0-4053-97aa-6cbd81fe819e', 'volume_name': 'volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6363920a-9fd2-4927-a155-6881e4ebbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6363920a-9fd2-4927-a155-6881e4ebbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1208aace-8f8a-4574-8134-7381579a704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Volume b1653ac4-07d0-4053-97aa-6cbd81fe819e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e', 'volume_size': 1} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86be36ec-9013-429a-90bc-425f191b09d1,created_at=2026-04-15T21:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705734757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86be36ec-9013-429a-90bc-425f191b09d1,host='devstack@QuobyteHD#QuobyteHD',id=b1653ac4-07d0-4053-97aa-6cbd81fe819e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e3aba1d97341eaa9f48767d8195030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:26Z,use_quota=True,user_id='9eb5d026c88e4161b203d23fad9e1eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c669ff4-f55e-4ccd-98d6-6d23b890e6a0),volume_type_id=6c669ff4-f55e-4ccd-98d6-6d23b890e6a0)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Creating volume b1653ac4-07d0-4053-97aa-6cbd81fe819e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:26 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:26 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e 1073741824 Apr 15 23:20:26 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Flow 'volume_create_manager' (9ae47360-863c-4f6f-b9a7-26888cd71b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b350ef1-7694-4f3a-9385-0ad1600b6af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b350ef1-7694-4f3a-9385-0ad1600b6af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1136750420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e1fd3e-17d6-441c-9d1e-fd70db42ac17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c0bce97f1d448aaf2ef8890f789138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:26Z,use_quota=True,user_id='c94948bd37e244aabe88306e06343e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d59dcbf-ac49-419a-adeb-ec8cc364d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d59dcbf-ac49-419a-adeb-ec8cc364d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dd7e34-ad5e-4652-921c-33fdb78b634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dd7e34-ad5e-4652-921c-33fdb78b634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e1fd3e-17d6-441c-9d1e-fd70db42ac17', 'volume_name': 'volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eefc63b-13a5-431f-bb52-38ebedba27db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eefc63b-13a5-431f-bb52-38ebedba27db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95691c06-0c7b-4506-bc70-f2d86021c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17', 'volume_size': 1} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-33748950-f64f-4d34-a7b7-c090fa6f4e5f-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-33748950-f64f-4d34-a7b7-c090fa6f4e5f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:26 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-quobyte-33748950-f64f-4d34-a7b7-c090fa6f4e5f" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.581s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Deleted volume successfully. Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-33748950-f64f-4d34-a7b7-c090fa6f4e5f" acquired by "delete_volume" :: waited 0.024s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-675ee5e8-c124-402f-b737-7bf21b00cf8e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-486cc078-75fc-48f5-aa96-1726c1beb76a-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc1efb-6f3e-4610-a741-cab1f99702de]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:26 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f Apr 15 23:20:26 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:26 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e 1073741824" returned: 0 in 0.679s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:26 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e Apr 15 23:20:26 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:27 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f" returned: 0 in 0.576s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:27 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f Apr 15 23:20:27 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:27 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e" returned: 0 in 0.521s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1136750420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e1fd3e-17d6-441c-9d1e-fd70db42ac17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c0bce97f1d448aaf2ef8890f789138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:26Z,use_quota=True,user_id='c94948bd37e244aabe88306e06343e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Creating volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:27 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1208aace-8f8a-4574-8134-7381579a704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216846d1-e899-4e3b-aaa8-9265e2b23c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Volume volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e (b1653ac4-07d0-4053-97aa-6cbd81fe819e): created successfully Apr 15 23:20:27 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 1073741824 Apr 15 23:20:27 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216846d1-e899-4e3b-aaa8-9265e2b23c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Flow 'volume_create_manager' (f62dddff-58d8-449f-a7e9-41845f9f1bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e10c193b-d93b-4cf8-be09-a729e2449241 tempest-GroupsTest-118205323 None] Created volume successfully. Apr 15 23:20:27 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-33748950-f64f-4d34-a7b7-c090fa6f4e5f" returned: 0 in 0.512s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-33748950-f64f-4d34-a7b7-c090fa6f4e5f" released by "delete_volume" :: held 1.119s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Created reservations ['1048f1fa-46bc-4133-977f-81ced0384443', '7bbc5ef0-20c7-436c-9dca-761d6011feba', '2ce725f9-7f9f-492d-b156-b19dd0179b7d', '94d3ac5d-0411-44dc-8c39-60cc6e282293'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:27 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:27 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:27 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 1073741824" returned: 0 in 0.587s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:28 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 Apr 15 23:20:28 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-795a0d0c-689a-400d-a13b-cc007b76ece7 tempest-GroupsTest-118205323 None] Update group completed successfully. Apr 15 23:20:28 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.487s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Deleted volume successfully. Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c02f9ebb-628a-4ce6-8ebc-1cf08e02d94e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-33748950-f64f-4d34-a7b7-c090fa6f4e5f-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:28 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" returned: 0 in 0.498s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95691c06-0c7b-4506-bc70-f2d86021c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ac05de-308a-4929-ae46-921a07c27c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Volume volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 (91e1fd3e-17d6-441c-9d1e-fd70db42ac17): created successfully Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ac05de-308a-4929-ae46-921a07c27c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Flow 'volume_create_manager' (9ae47360-863c-4f6f-b9a7-26888cd71b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-82d7836b-20cc-44eb-aa85-bb4fdbbee7a7 tempest-SnapshotsActionsTest-1593474859 None] Created volume successfully. Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-4d508e73-6bc0-4583-87c1-f32aa9de8e50-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-4d508e73-6bc0-4583-87c1-f32aa9de8e50-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-quobyte-4d508e73-6bc0-4583-87c1-f32aa9de8e50" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-4d508e73-6bc0-4583-87c1-f32aa9de8e50" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41e6614-91d9-49b1-8a48-a95c54da28af]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:28 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 Apr 15 23:20:28 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:29 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50" returned: 0 in 0.538s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:29 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50 Apr 15 23:20:29 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e8b61be3-5388-42e0-a635-86e7be13f8bd tempest-GroupsTest-118205323 None] Update group completed successfully. Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Creating offline snapshot 422529b4-ee48-4aaa-b14c-509d9e606d69 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4953ee-8b39-4f09-801b-feca7ff49fde]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:29 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 Apr 15 23:20:29 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:29 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4d508e73-6bc0-4583-87c1-f32aa9de8e50" returned: 0 in 0.516s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-4d508e73-6bc0-4583-87c1-f32aa9de8e50" released by "delete_volume" :: held 1.085s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:29 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Created reservations ['dd01f112-8f60-4889-b2d9-e6a57ff31c8c', '5bbcf1d7-99e8-4a04-bc7d-1521903ee6d5', '7a973c7c-77ca-4c4f-b829-e0f1c7141890', '395b3f98-6898-42af-974b-be37d72d22d9'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:30 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:30 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:30 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" returned: 0 in 0.499s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:30 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 1G Apr 15 23:20:30 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:30 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.428s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:30 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Deleted volume successfully. Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f9fb667b-0c0c-4891-a4b0-e2911d9eb0aa tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-4d508e73-6bc0-4583-87c1-f32aa9de8e50-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:30 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 1G" returned: 0 in 0.544s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:30 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:30 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Acquiring lock "cinder-quobyte-6e0d7d63-b1cd-44ee-8acf-617e4a873957" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Lock "cinder-quobyte-6e0d7d63-b1cd-44ee-8acf-617e4a873957" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e7f7c-0508-4ad8-913c-df6a839090fa]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-bf0bfb1a-e966-4708-86da-e85b38785ac4-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-bf0bfb1a-e966-4708-86da-e85b38785ac4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:31 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 Apr 15 23:20:31 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-quobyte-bf0bfb1a-e966-4708-86da-e85b38785ac4" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-bf0bfb1a-e966-4708-86da-e85b38785ac4" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee6c611-438b-4864-a680-d9d731896f12]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:31 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 Apr 15 23:20:31 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:31 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.544s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:31 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 is being set with open permissions: ugo+rw Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:31 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:31 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:31 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957" returned: 0 in 0.741s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:31 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957 Apr 15 23:20:31 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:31 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4" returned: 0 in 0.582s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:31 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4 Apr 15 23:20:31 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:31 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.559s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:31 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.info Apr 15 23:20:31 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:32 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6e0d7d63-b1cd-44ee-8acf-617e4a873957" returned: 0 in 0.552s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Lock "cinder-quobyte-6e0d7d63-b1cd-44ee-8acf-617e4a873957" released by "delete_volume" :: held 1.338s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Acquiring lock "cinder-quobyte-b1653ac4-07d0-4053-97aa-6cbd81fe819e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:32 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bf0bfb1a-e966-4708-86da-e85b38785ac4" returned: 0 in 0.525s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Lock "cinder-quobyte-b1653ac4-07d0-4053-97aa-6cbd81fe819e" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-bf0bfb1a-e966-4708-86da-e85b38785ac4" released by "delete_volume" :: held 1.135s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[393a2364-677a-4847-aab7-4d5023d5098e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Created reservations ['a81b29dd-9bcf-4be0-b2b3-1655b84c31b4', '9c17498f-249f-4316-9d8f-d42719c3e8b0', '3a9f17ad-71cf-4e93-8ccc-4a2e998f7c7d', '4f475b5a-73f0-43f8-81ae-45f0633df6e8'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:32 devstack sudo[86329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e Apr 15 23:20:32 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:32 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:32 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:32 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.info" returned: 0 in 0.577s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:32 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.info is being set with open permissions: ugo+rw Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:32 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.info Apr 15 23:20:32 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:32 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e" returned: 0 in 0.521s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:32 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e Apr 15 23:20:32 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:33 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.686s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Deleted volume successfully. Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-49d4212f-9dc5-4506-bd77-11edb9edd0d6 tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-bf0bfb1a-e966-4708-86da-e85b38785ac4-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:33 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.info" returned: 0 in 0.713s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.514s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-53109b03-1d41-43b8-b596-819065c40bd8-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cd6806af-1975-47eb-944b-5b4fefd97c70 tempest-SnapshotsActionsTest-1593474859 None] Create snapshot completed successfully Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-53109b03-1d41-43b8-b596-819065c40bd8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:33 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b1653ac4-07d0-4053-97aa-6cbd81fe819e" returned: 0 in 0.604s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "cinder-quobyte-53109b03-1d41-43b8-b596-819065c40bd8" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Lock "cinder-quobyte-b1653ac4-07d0-4053-97aa-6cbd81fe819e" released by "delete_volume" :: held 1.157s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-53109b03-1d41-43b8-b596-819065c40bd8" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd48ae-51b2-4d5c-a4f8-f5cca084853b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Created reservations ['2b4ad1a0-9506-43d5-a5ff-58a97ee2fca9'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:33 devstack cinder-volume[82388]: WARNING cinder.quota [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2055002566 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2055002566, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:20:33 devstack cinder-volume[82388]: WARNING cinder.quota [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2055002566 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2055002566, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Created reservations ['553bd77f-3818-43cb-ad31-2f8a0f061f69', '667af1f3-b210-4698-a5a5-f147bbf689cc', '2bfd3050-31d3-46b7-8885-e663ae505cd8', 'd56e4341-7e79-4ebf-b4e8-17bb2b9a9521'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:33 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 Apr 15 23:20:33 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Created reservations ['a021c508-ed87-4288-bc50-3a0cdcc2224e', 'b0b6189d-920f-4cda-85c6-385f5cff334d', '39e0ee89-d745-445b-ace1-5c887cb4a3b7', '0a70decb-1802-4bdf-af57-a2fd5eed6f80'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:33 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:33 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:33 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8" returned: 0 in 0.535s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:33 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8 Apr 15 23:20:33 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:34 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.615s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:34 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c5f8aec3-9811-4820-8fb6-682cd3182aa8 tempest-GroupsTest-118205323 None] Delete group completed successfully. Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Creating offline snapshot b66badfd-552f-4252-9492-92c0318a3dbd of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a79ecb2-3b51-487f-bdc0-a3fb85af18c0]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:34 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-53109b03-1d41-43b8-b596-819065c40bd8" returned: 0 in 0.619s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-quobyte-53109b03-1d41-43b8-b596-819065c40bd8" released by "delete_volume" :: held 1.184s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Created reservations ['48bf2283-8674-4e21-b680-35989e3bbcfa', '31c953fb-aa8e-4db8-bcc7-3da8feb48324', 'a02fcaf5-2ada-4748-b6fb-886291ea96c7', '6cb258fe-df5d-4461-b277-489253536436'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:34 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:34 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:34 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:34 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:35 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.459s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:35 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Deleted volume successfully. Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-22d849a6-7778-46e3-9a09-af74d160ce9e tempest-CreateVolumesFromImageTest-537211574 None] Lock "cinder-53109b03-1d41-43b8-b596-819065c40bd8-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:35 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.674s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:35 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd 1G Apr 15 23:20:35 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:35 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd 1G" returned: 0 in 0.808s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:35 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd Apr 15 23:20:35 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:36 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd" returned: 0 in 0.727s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:36 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd is being set with open permissions: ugo+rw Apr 15 23:20:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:36 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd Apr 15 23:20:36 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:37 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd" returned: 0 in 0.696s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.986s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:37 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1bbd94d7-e0ae-4c81-a98b-5f4cfe3d43b8 tempest-SnapshotsActionsTest-1593474859 None] Create snapshot completed successfully Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-b66badfd-552f-4252-9492-92c0318a3dbd-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-b66badfd-552f-4252-9492-92c0318a3dbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-b66badfd-552f-4252-9492-92c0318a3dbd" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-b66badfd-552f-4252-9492-92c0318a3dbd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Deleting offline snapshot b66badfd-552f-4252-9492-92c0318a3dbd of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] snapshot_file for this snap is: volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5566c04b-5c9c-444f-8187-cf4b393df9c7]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:37 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd Apr 15 23:20:37 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c69ff600-ddb8-480b-84d0-791d23711581 tempest-GroupsV320Test-94322651 None] Group tempest-GroupsV320Test-Group-831635405: creating Apr 15 23:20:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c69ff600-ddb8-480b-84d0-791d23711581 tempest-GroupsV320Test-94322651 None] Group tempest-GroupsV320Test-Group-831635405: created successfully Apr 15 23:20:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c69ff600-ddb8-480b-84d0-791d23711581 tempest-GroupsV320Test-94322651 None] Create group completed successfully. Apr 15 23:20:38 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd" returned: 0 in 0.645s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:38 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d3413c-fe2f-45c6-9a15-6823f8163a4b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:38 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:38 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:38 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:38 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd Apr 15 23:20:38 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:39 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd" returned: 0 in 0.527s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:39 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd Apr 15 23:20:39 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Created reservations ['bf5bb8fc-d4c0-4ea1-b547-7485136ea0a4'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:39 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:20:39 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:39 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.b66badfd-552f-4252-9492-92c0318a3dbd" returned: 0 in 0.440s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-b66badfd-552f-4252-9492-92c0318a3dbd" released by "_delete_snapshot" :: held 2.156s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" released by "delete_snapshot" :: held 2.167s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:39 devstack cinder-volume[82388]: WARNING cinder.quota [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:20:39 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Created reservations ['65db454f-519d-4149-82a6-04e02a412971', '84942893-48c0-4d58-a7fc-da93971c76d0', '791d56a2-1469-4935-a004-9a2d0cbfacf3', '175d4e99-e322-412f-a676-51b745fbe90b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Delete snapshot completed successfully. Apr 15 23:20:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-100652e2-faae-4ac1-a781-dff82fceb403 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-b66badfd-552f-4252-9492-92c0318a3dbd-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:40 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.436s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:40 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:20:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8677acb5-fa56-40eb-8d33-e43b07d01bdf tempest-GroupsV320Test-94322651 None] Delete group completed successfully. Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=211,cinder:UPDATE=255,cinder:INSERT=65,cinder:DELETE=13 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Creating offline snapshot 2a3b118c-a209-4cb5-9ac4-1052d997be55 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[80928b6b-3363-483d-ae2b-52aaacfe3aca]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:41 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:41 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:41 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.685s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:41 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 1G Apr 15 23:20:41 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:42 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 1G" returned: 0 in 0.804s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:42 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 Apr 15 23:20:42 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:43 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55" returned: 0 in 0.775s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:43 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 is being set with open permissions: ugo+rw Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:43 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 Apr 15 23:20:43 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Flow 'volume_create_manager' (2f18dfbd-ab28-46ea-b1a2-1d6f497db54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b213ab97-ffa2-4a35-93e5-93d3e87eb641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b213ab97-ffa2-4a35-93e5-93d3e87eb641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b619d6e1-ca63-44b0-b977-61916735c2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cf05e45bab40949a0f9ca3a3219e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:44Z,use_quota=True,user_id='a54b4df65fb84edbb6d3fd0da6d3824b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9855b8-f63f-4480-95ec-2adb1985444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9855b8-f63f-4480-95ec-2adb1985444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33586364-3f1c-4f7f-95e2-9c95265f7c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.image.glance [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Creating Keystone auth plugin from conf {{(pid=82388) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33586364-3f1c-4f7f-95e2-9c95265f7c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b619d6e1-ca63-44b0-b977-61916735c2aa', 'volume_name': 'volume-b619d6e1-ca63-44b0-b977-61916735c2aa', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f521f991-0ae5-4e77-a633-24f1ddeba65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f521f991-0ae5-4e77-a633-24f1ddeba65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0293c416-1dbb-4ede-903e-a2da2c64a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:43 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Volume b619d6e1-ca63-44b0-b977-61916735c2aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b619d6e1-ca63-44b0-b977-61916735c2aa', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 23:20:43 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Trying to clone b619d6e1-ca63-44b0-b977-61916735c2aa from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]). {{(pid=82388) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 23:20:44 devstack cinder-volume[82388]: INFO cinder.image.image_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Image download 20.69 MB at 20.69 MB/s Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec3095-4f23-467a-9f04-bca12c102322]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:44 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD Apr 15 23:20:44 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:44 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55" returned: 0 in 0.765s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.175s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-da1391b6-b73e-4ff1-82cf-8604c491eb1f tempest-SnapshotsActionsTest-1593474859 None] Create snapshot completed successfully Apr 15 23:20:44 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD" returned: 0 in 0.545s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 is fetched for user a54b4df65fb84edbb6d3fd0da6d3824b. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06640a4-c6be-4eb5-bdde-9f4f10d7b190]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:44 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD Apr 15 23:20:44 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:45 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:20:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b619d6e1-ca63-44b0-b977-61916735c2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cf05e45bab40949a0f9ca3a3219e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:20:44Z,use_quota=True,user_id='a54b4df65fb84edbb6d3fd0da6d3824b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Creating volume b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:20:45 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:45 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa 1073741824 Apr 15 23:20:45 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-2a3b118c-a209-4cb5-9ac4-1052d997be55-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-2a3b118c-a209-4cb5-9ac4-1052d997be55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-2a3b118c-a209-4cb5-9ac4-1052d997be55" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-2a3b118c-a209-4cb5-9ac4-1052d997be55" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Deleting offline snapshot 2a3b118c-a209-4cb5-9ac4-1052d997be55 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] snapshot_file for this snap is: volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829048a-7c98-44d9-ba33-0534cfdb6988]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:45 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 Apr 15 23:20:45 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:46 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa 1073741824" returned: 0 in 0.856s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:46 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55" returned: 0 in 0.681s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[71402635-398f-4bac-8829-d4ba4f38a5c1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:46 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:20:46 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:46 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:46 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:46 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 0 in 0.576s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Attempting download of 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume b619d6e1-ca63-44b0-b977-61916735c2aa. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d060536-deaa-42e1-9efd-7a0c38ef52ba]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_tprg30qe {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:46 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.714s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:47 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 Apr 15 23:20:47 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:47 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_tprg30qe Apr 15 23:20:47 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:47 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55" returned: 0 in 0.582s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:47 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55 Apr 15 23:20:47 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:47 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_tprg30qe" returned: 0 in 0.653s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_tprg30qe {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:47 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_tprg30qe Apr 15 23:20:47 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:47 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.2a3b118c-a209-4cb5-9ac4-1052d997be55" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-2a3b118c-a209-4cb5-9ac4-1052d997be55" released by "_delete_snapshot" :: held 2.551s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" released by "delete_snapshot" :: held 2.572s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:48 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_tprg30qe" returned: 1 in 0.533s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_tprg30qe' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[63377698-6748-4fef-ac24-0e874cc3e3f3]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Created reservations ['b726e58c-9f8f-4e8e-8edd-b76c54082942', '1491872f-9b52-4710-b715-326fa8499a5c', '68bace9f-0f2a-4da3-a491-bbc6014e2565', '17e9a39c-2840-454b-8603-d8331236de4a'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:48 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Delete snapshot completed successfully. Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc517bd9-a67e-40eb-94cd-151a3c4cc12b tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-2a3b118c-a209-4cb5-9ac4-1052d997be55-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:48 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD Apr 15 23:20:48 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:48 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD" returned: 0 in 0.616s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] 7964c2ec-4e08-4c1d-802c-6b54500d24d6 was qcow2, converting to raw {{(pid=82388) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:48 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:20:48 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Creating offline snapshot 462a1b77-d5cb-466e-bd9a-cbc601f12565 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16f1de-ddd1-4575-8b7d-7ed526cbe236]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:49 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:49 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:49 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:49 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 1G Apr 15 23:20:49 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:49 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 0 in 1.191s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:49 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_pb_2vfp1devstack@QuobyteHD, size 112.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:20:49 devstack cinder-volume[82388]: INFO cinder.image.image_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Converted 112.00 MB image at 93.91 MB/s Apr 15 23:20:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:49 devstack sudo[86513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa 1G Apr 15 23:20:49 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:50 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 1G" returned: 0 in 0.863s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:50 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 Apr 15 23:20:50 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:50 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa 1G" returned: 0 in 0.545s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:50 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8426c0a-3bbb-4cc7-a248-334a1c5a4935]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:50 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:20:50 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:50 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565" returned: 0 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:50 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 is being set with open permissions: ugo+rw Apr 15 23:20:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:50 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 Apr 15 23:20:50 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:51 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 0 in 0.733s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:51 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:20:51 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:51 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565" returned: 0 in 0.548s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=209,cinder:SELECT=189,cinder:INSERT=58,cinder:DELETE=15 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:51 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-42268ce7-8d5f-446f-b4da-acd327ae42e9 tempest-SnapshotsActionsTest-1593474859 None] Create snapshot completed successfully Apr 15 23:20:51 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 1 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Downloaded image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume b619d6e1-ca63-44b0-b977-61916735c2aa successfully. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 for user a54b4df65fb84edbb6d3fd0da6d3824b is deleted. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Marking volume b619d6e1-ca63-44b0-b977-61916735c2aa as bootable. {{(pid=82388) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Copying metadata from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 to b619d6e1-ca63-44b0-b977-61916735c2aa. {{(pid=82388) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Creating volume glance metadata for volume b619d6e1-ca63-44b0-b977-61916735c2aa backed by image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82388) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0293c416-1dbb-4ede-903e-a2da2c64a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b619d6e1-ca63-44b0-b977-61916735c2aa', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077fc85a-d09c-4631-9c42-1e438052bd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:20:51 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Volume volume-b619d6e1-ca63-44b0-b977-61916735c2aa (b619d6e1-ca63-44b0-b977-61916735c2aa): created successfully Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077fc85a-d09c-4631-9c42-1e438052bd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:20:51 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Flow 'volume_create_manager' (2f18dfbd-ab28-46ea-b1a2-1d6f497db54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:20:51 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-518418f3-026e-442a-9c5d-0ef27cbd1e35 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Created volume successfully. Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-462a1b77-d5cb-466e-bd9a-cbc601f12565-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-462a1b77-d5cb-466e-bd9a-cbc601f12565-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-462a1b77-d5cb-466e-bd9a-cbc601f12565" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-462a1b77-d5cb-466e-bd9a-cbc601f12565" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Deleting offline snapshot 462a1b77-d5cb-466e-bd9a-cbc601f12565 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] snapshot_file for this snap is: volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df1bc67-11f0-44ec-93f8-7946619bda01]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:52 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 Apr 15 23:20:52 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:52 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565" returned: 0 in 0.647s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3641c1e-d36f-4719-9865-d16b350cc8b1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:52 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:52 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:53 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5a6168-3ac1-4292-a780-75703e09b75b]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:53 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:20:53 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:53 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:53 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 Apr 15 23:20:53 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:54 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565" returned: 0 in 0.599s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:54 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565 Apr 15 23:20:54 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:54 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 0 in 0.843s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:54 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:20:54 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:54 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.462a1b77-d5cb-466e-bd9a-cbc601f12565" returned: 0 in 0.586s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-462a1b77-d5cb-466e-bd9a-cbc601f12565" released by "_delete_snapshot" :: held 2.495s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" released by "delete_snapshot" :: held 2.508s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Created reservations ['03acf927-4807-4092-90d3-245f7a95592d', '15ae92fa-e8e0-443e-a297-3c9eae213dc8', '86ae43bf-25e1-4792-a89c-3648488205bb', '1fa057aa-3437-4665-b7fc-63c84780d22a'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:20:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Delete snapshot completed successfully. Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ecd968d-fbb3-4e12-bfc1-aaf8ef5992ef tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-462a1b77-d5cb-466e-bd9a-cbc601f12565-delete_snapshot" released by "delete_snapshot" :: held 2.770s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:20:54 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 1 in 0.870s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.800s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037', 'name': 'volume-b619d6e1-ca63-44b0-b977-61916735c2aa', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c47f179-a0fb-4da9-b89c-310e39107464', 'enforce_multipath': True} {{(pid=82388) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 23:20:55 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-4f835aed-3aa3-4f4d-af4b-32fbfade3694 req-1434ba51-ff86-43e3-8959-b8b44b3820b8 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] attachment_update completed successfully. Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Creating offline snapshot 741922ab-cb5f-4e37-82a0-dc18b2d5b160 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc7c040-06a9-4cfa-b589-15fb5a335559]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:55 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:55 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:56 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.677s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:56 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 1G Apr 15 23:20:56 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:56 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 1G" returned: 0 in 0.557s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:56 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 Apr 15 23:20:56 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:57 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160" returned: 0 in 0.551s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:57 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 is being set with open permissions: ugo+rw Apr 15 23:20:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:57 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 Apr 15 23:20:57 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:58 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160" returned: 0 in 0.535s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:20:58 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ce9d5d4f-8d3f-4c66-bc71-d05545083f6d tempest-SnapshotsActionsTest-1593474859 None] Create snapshot completed successfully Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-741922ab-cb5f-4e37-82a0-dc18b2d5b160-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-741922ab-cb5f-4e37-82a0-dc18b2d5b160-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Acquiring lock "cinder-quobyte-741922ab-cb5f-4e37-82a0-dc18b2d5b160" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-741922ab-cb5f-4e37-82a0-dc18b2d5b160" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Deleting offline snapshot 741922ab-cb5f-4e37-82a0-dc18b2d5b160 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] snapshot_file for this snap is: volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ba909-6bed-48ee-aac3-2979e127e4c4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:59 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 Apr 15 23:20:59 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:20:59 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 15 23:20:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160" returned: 0 in 0.755s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:20:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:20:59 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10578a1-10b7-4b6b-aad6-9ac6e597a3bd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:20:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:20:59 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:20:59 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:00 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.732s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:21:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:00 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 Apr 15 23:21:00 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:01 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160" returned: 0 in 0.745s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:01 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160 Apr 15 23:21:01 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:01 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.741922ab-cb5f-4e37-82a0-dc18b2d5b160" returned: 0 in 0.615s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-741922ab-cb5f-4e37-82a0-dc18b2d5b160" released by "_delete_snapshot" :: held 2.924s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" released by "delete_snapshot" :: held 2.939s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:01 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Created reservations ['cb731c13-b55d-4fd7-b8ad-3ec73b8f7d3f', '625c59e7-7d22-43d5-89ee-5843e6d7baee', '3b7895ff-c085-48c9-941e-b75c66462990', '9928d7df-a3b0-4b2b-9bad-cc39e37fa853'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Delete snapshot completed successfully. Apr 15 23:21:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af769d20-33c1-4c00-87cd-b59f9e413916 tempest-SnapshotsActionsTest-1915329451 None] Lock "cinder-741922ab-cb5f-4e37-82a0-dc18b2d5b160-delete_snapshot" released by "delete_snapshot" :: held 3.109s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "cinder-422529b4-ee48-4aaa-b14c-509d9e606d69-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-422529b4-ee48-4aaa-b14c-509d9e606d69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "cinder-quobyte-422529b4-ee48-4aaa-b14c-509d9e606d69" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-quobyte-422529b4-ee48-4aaa-b14c-509d9e606d69" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Deleting offline snapshot 422529b4-ee48-4aaa-b14c-509d9e606d69 of volume 91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] snapshot_file for this snap is: volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccbdcf0-890f-4041-808b-b344d1348ce1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:02 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:21:02 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:03 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.608s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:21:03 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf855d7-ae9d-42a3-bfb1-f2d5dd0df05a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:03 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 Apr 15 23:21:03 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:03 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" returned: 0 in 0.658s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:03 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:21:03 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:04 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.554s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:04 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69 Apr 15 23:21:04 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:04 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17.422529b4-ee48-4aaa-b14c-509d9e606d69" returned: 0 in 0.536s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-quobyte-422529b4-ee48-4aaa-b14c-509d9e606d69" released by "_delete_snapshot" :: held 2.498s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" released by "delete_snapshot" :: held 2.524s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Created reservations ['19c06ef5-ffd6-42ad-8d7a-1dbb24b4fcd7', '77d5fca7-457c-4641-be11-818861fd8bab', '8450cb69-7ef6-4591-9376-1863752cc59d', '120d0b8f-be1d-4699-9d5c-3bc447171a02'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Delete snapshot completed successfully. Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-251b4893-6c00-4b8a-a191-3224029f3f9c tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-422529b4-ee48-4aaa-b14c-509d9e606d69-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "cinder-91e1fd3e-17d6-441c-9d1e-fd70db42ac17-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-91e1fd3e-17d6-441c-9d1e-fd70db42ac17-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" acquired by "delete_volume" :: waited 0.021s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb994e6d-470a-4b68-b4ff-665b3861fa41]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:06 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 Apr 15 23:21:06 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:06 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" returned: 0 in 0.994s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:06 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17 Apr 15 23:21:06 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:07 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" returned: 0 in 0.647s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-quobyte-91e1fd3e-17d6-441c-9d1e-fd70db42ac17" released by "delete_volume" :: held 1.747s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Created reservations ['44389a0e-3e03-4f79-b951-16b0ae32704d', '9532ea24-87f8-42ea-b697-a926979397b1', '73f4cbec-93f6-4d2b-8ee9-4b8cbeed6fd8', 'a00f18a2-b022-4bd2-8c0f-82b28cfdfeff'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:07 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:07 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:08 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.569s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:08 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:08 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Deleted volume successfully. Apr 15 23:21:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-560fb9e0-4895-4785-933f-a4b441062ffb tempest-SnapshotsActionsTest-1593474859 None] Lock "cinder-91e1fd3e-17d6-441c-9d1e-fd70db42ac17-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Flow 'volume_create_manager' (0c461c4e-47cc-4724-b18f-b7505a057446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed4be82-8128-486c-8050-eb572d1222d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed4be82-8128-486c-8050-eb572d1222d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-938603212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c27043-cd65-4e10-9afb-9d2aada271fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be7c18402a24c31a07437056bf125cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:15Z,use_quota=True,user_id='1b9877502dba490697581bbd35b57fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ecadbf-ba74-4c79-9738-11c923348307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ecadbf-ba74-4c79-9738-11c923348307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5285e469-ac02-4308-ac96-f36bb62f8b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5285e469-ac02-4308-ac96-f36bb62f8b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c27043-cd65-4e10-9afb-9d2aada271fc', 'volume_name': 'volume-75c27043-cd65-4e10-9afb-9d2aada271fc', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e277457-bf49-4d20-98c8-d53122fcbfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e277457-bf49-4d20-98c8-d53122fcbfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47fc729-fc72-4462-b332-b57ec84e8a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Volume 75c27043-cd65-4e10-9afb-9d2aada271fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c27043-cd65-4e10-9afb-9d2aada271fc', 'volume_size': 1} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-938603212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c27043-cd65-4e10-9afb-9d2aada271fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be7c18402a24c31a07437056bf125cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:15Z,use_quota=True,user_id='1b9877502dba490697581bbd35b57fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Creating volume 75c27043-cd65-4e10-9afb-9d2aada271fc {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:14 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:14 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc 1073741824 Apr 15 23:21:14 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:14 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:14 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:15 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.681s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:15 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc 1073741824" returned: 0 in 0.876s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:15 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc Apr 15 23:21:15 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:16 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc" returned: 0 in 0.591s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47fc729-fc72-4462-b332-b57ec84e8a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c27043-cd65-4e10-9afb-9d2aada271fc', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d389cc4-4839-4f57-a81d-ddb40f40d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:16 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Volume volume-75c27043-cd65-4e10-9afb-9d2aada271fc (75c27043-cd65-4e10-9afb-9d2aada271fc): created successfully Apr 15 23:21:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d389cc4-4839-4f57-a81d-ddb40f40d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Flow 'volume_create_manager' (0c461c4e-47cc-4724-b18f-b7505a057446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:16 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d40e7ef4-9d63-4372-8a7d-247f1fb22ee0 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Created volume successfully. Apr 15 23:21:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Acquiring lock "cinder-75c27043-cd65-4e10-9afb-9d2aada271fc-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "cinder-75c27043-cd65-4e10-9afb-9d2aada271fc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Acquiring lock "cinder-quobyte-75c27043-cd65-4e10-9afb-9d2aada271fc" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "cinder-quobyte-75c27043-cd65-4e10-9afb-9d2aada271fc" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:17 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c88855-a181-4cf8-80b5-ea9a7cbb37ee]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:17 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc Apr 15 23:21:17 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:18 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc" returned: 0 in 0.744s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:18 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc Apr 15 23:21:18 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:18 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-75c27043-cd65-4e10-9afb-9d2aada271fc" returned: 0 in 0.567s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "cinder-quobyte-75c27043-cd65-4e10-9afb-9d2aada271fc" released by "delete_volume" :: held 1.350s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Created reservations ['9d2b9440-ef0a-4bc9-b5a2-9090172e6f51', '617c2b39-075c-412a-9ec4-0f4ace998e9b', '30659c28-fba1-428d-ba38-76d976bb5b83', '4120ae17-ef9c-4424-8cbd-91075b5f9499'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:19 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:19 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:19 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.510s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Deleted volume successfully. Apr 15 23:21:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-53e2cfb9-0778-4b6b-bbee-1cafaa05f2a4 tempest-VolumeQuotasNegativeTestJSON-761210044 None] Lock "cinder-75c27043-cd65-4e10-9afb-9d2aada271fc-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:23 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-49c605d6-d28c-4076-bb17-58232a70dbad tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Terminate volume connection completed successfully. Apr 15 23:21:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-49c605d6-d28c-4076-bb17-58232a70dbad tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Deleting attachment 8c47f179-a0fb-4da9-b89c-310e39107464. {{(pid=82388) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "cinder-b619d6e1-ca63-44b0-b977-61916735c2aa-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-b619d6e1-ca63-44b0-b977-61916735c2aa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "cinder-quobyte-b619d6e1-ca63-44b0-b977-61916735c2aa" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-quobyte-b619d6e1-ca63-44b0-b977-61916735c2aa" acquired by "delete_volume" :: waited 0.019s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[06785d78-836c-4eeb-8958-faf1886a3c64]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (2f61221c-da20-43e1-9db4-4c29ee45773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeac7fd-5c13-4c71-a494-f0c4a2a0baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeac7fd-5c13-4c71-a494-f0c4a2a0baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-421885575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:24Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:21:24 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe687a7-98e2-4bd8-9432-21b2f7efe3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe687a7-98e2-4bd8-9432-21b2f7efe3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49bba0f-9479-42bb-a5aa-8f9a47c51e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49bba0f-9479-42bb-a5aa-8f9a47c51e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3', 'volume_name': 'volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bbd051-8f48-4b0b-bff7-dde4a27df4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bbd051-8f48-4b0b-bff7-dde4a27df4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecab8e0a-572d-4d45-a73a-4d9565a7db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Volume 3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3', 'volume_size': 1} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-421885575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:24Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Creating volume 3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:24 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:24 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 1073741824 Apr 15 23:21:24 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Flow 'volume_create_manager' (8d33824a-0a16-4a19-86d0-cd3e14321411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6656b31f-0ef9-43f3-9f87-dfd8705bc99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6656b31f-0ef9-43f3-9f87-dfd8705bc99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-885234640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c618a64-04e4-4d7d-adbc-dd31377ab88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9b25fe088641a4a5e2a78adfd3fa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:25Z,use_quota=True,user_id='3d53a8bb108148449b15f79b84db5945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ba1aeb2-88e5-47a6-9f4d-8770ec34b1db),volume_type_id=2ba1aeb2-88e5-47a6-9f4d-8770ec34b1db)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce6f4fe-52e9-4c2a-b54c-61a5303dbc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce6f4fe-52e9-4c2a-b54c-61a5303dbc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc09b0ea-30a0-4087-bd4a-48f3aee18f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc09b0ea-30a0-4087-bd4a-48f3aee18f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c618a64-04e4-4d7d-adbc-dd31377ab88e', 'volume_name': 'volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fa1334-50da-4373-a158-f9de15668704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99fa1334-50da-4373-a158-f9de15668704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de51890-c12e-4e45-a4fd-6b5b4da08476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:24 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Volume 2c618a64-04e4-4d7d-adbc-dd31377ab88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e', 'volume_size': 1} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:24 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 0 in 0.583s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:24 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:21:24 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:25 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 1073741824" returned: 0 in 0.746s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:25 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 Apr 15 23:21:25 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:25 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 1 in 0.558s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:25 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa Apr 15 23:21:25 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:25 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" returned: 0 in 0.421s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-885234640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c618a64-04e4-4d7d-adbc-dd31377ab88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9b25fe088641a4a5e2a78adfd3fa98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:25Z,use_quota=True,user_id='3d53a8bb108148449b15f79b84db5945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ba1aeb2-88e5-47a6-9f4d-8770ec34b1db),volume_type_id=2ba1aeb2-88e5-47a6-9f4d-8770ec34b1db)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Creating volume 2c618a64-04e4-4d7d-adbc-dd31377ab88e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:25 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecab8e0a-572d-4d45-a73a-4d9565a7db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:25 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e 1073741824 Apr 15 23:21:25 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980f6d40-bb10-4e99-ba86-b1befe8b4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:25 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Volume volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 (3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3): created successfully Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980f6d40-bb10-4e99-ba86-b1befe8b4386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (2f61221c-da20-43e1-9db4-4c29ee45773a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:25 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-341b8f47-ea8a-4f97-a850-b6df2ebd0cfc tempest-VolumesActionsTest-831974169 None] Created volume successfully. Apr 15 23:21:25 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b619d6e1-ca63-44b0-b977-61916735c2aa" returned: 0 in 0.486s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-quobyte-b619d6e1-ca63-44b0-b977-61916735c2aa" released by "delete_volume" :: held 1.685s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:25 devstack cinder-volume[82388]: DEBUG cinder.quota [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Created reservations ['07d06387-bc14-4768-bdd2-842edcafce68', '7c04bc0a-be8e-4697-b6a6-40b5549075d5', 'a9bf0190-b820-4c6f-9943-87dc6826b3c2', '812be701-fdeb-46d4-9fad-bdcf353597b9'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:26 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:26 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:26 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e 1073741824" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:26 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e Apr 15 23:21:26 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5fa5e92e-6c95-4d7c-bbb3-0b69c00f21e0 tempest-VolumesActionsTest-831974169 None] Acquiring lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" by "attach_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5fa5e92e-6c95-4d7c-bbb3-0b69c00f21e0 tempest-VolumesActionsTest-831974169 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" acquired by "attach_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5fa5e92e-6c95-4d7c-bbb3-0b69c00f21e0 tempest-VolumesActionsTest-831974169 None] Attaching volume 3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 to instance 29dba8a5-33bc-4c0d-a7ee-d54a38838a11 at mountpoint /dev/vdb on host None. Apr 15 23:21:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5fa5e92e-6c95-4d7c-bbb3-0b69c00f21e0 tempest-VolumesActionsTest-831974169 None] Attach volume completed successfully. Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5fa5e92e-6c95-4d7c-bbb3-0b69c00f21e0 tempest-VolumesActionsTest-831974169 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" released by "attach_volume" :: held 0.079s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:26 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.465s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.manager [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Deleted volume successfully. Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-1d8f86e1-ca76-4132-9e76-5f1ef2cfb1e3 req-688bc29d-30b8-45ab-85e2-6cf3fc1806c2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-b619d6e1-ca63-44b0-b977-61916735c2aa-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:26 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e" returned: 0 in 0.429s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de51890-c12e-4e45-a4fd-6b5b4da08476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed90ee9-c519-400a-8a88-a9e9f7ce533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Volume volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e (2c618a64-04e4-4d7d-adbc-dd31377ab88e): created successfully Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed90ee9-c519-400a-8a88-a9e9f7ce533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Flow 'volume_create_manager' (8d33824a-0a16-4a19-86d0-cd3e14321411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-db88613a-d162-4a80-81a7-14387aced518 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Created volume successfully. Apr 15 23:21:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-716129ae-f890-4426-8778-aaf05ca545ea tempest-VolumesActionsTest-294358715 None] Terminate volume connection completed successfully. Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-716129ae-f890-4426-8778-aaf05ca545ea tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-detach_volume" by "detach_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-716129ae-f890-4426-8778-aaf05ca545ea tempest-VolumesActionsTest-294358715 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-716129ae-f890-4426-8778-aaf05ca545ea tempest-VolumesActionsTest-294358715 None] Detaching volume 3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 from instance 29dba8a5-33bc-4c0d-a7ee-d54a38838a11. Apr 15 23:21:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-716129ae-f890-4426-8778-aaf05ca545ea tempest-VolumesActionsTest-294358715 None] Detach volume completed successfully. Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-716129ae-f890-4426-8778-aaf05ca545ea tempest-VolumesActionsTest-294358715 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:28 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:28 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6e456318-74df-4ba6-8d8f-69e6b31bc390 tempest-VolumesActionsTest-831974169 None] Acquiring lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-detach_volume" by "detach_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6e456318-74df-4ba6-8d8f-69e6b31bc390 tempest-VolumesActionsTest-831974169 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6e456318-74df-4ba6-8d8f-69e6b31bc390 tempest-VolumesActionsTest-831974169 None] Volume detach called, but volume not attached. Apr 15 23:21:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6e456318-74df-4ba6-8d8f-69e6b31bc390 tempest-VolumesActionsTest-831974169 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:28 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.634s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:28 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5a61457c-759b-47f9-a7d4-e23f96d8809d tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Retype volume completed successfully. Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Acquiring lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Acquiring lock "cinder-2c618a64-04e4-4d7d-adbc-dd31377ab88e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "cinder-2c618a64-04e4-4d7d-adbc-dd31377ab88e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Acquiring lock "cinder-quobyte-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Lock "cinder-quobyte-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" acquired by "delete_volume" :: waited 0.019s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e58ae-5407-470a-a41d-26309c1e7606]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Acquiring lock "cinder-quobyte-2c618a64-04e4-4d7d-adbc-dd31377ab88e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "cinder-quobyte-2c618a64-04e4-4d7d-adbc-dd31377ab88e" acquired by "delete_volume" :: waited 0.022s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f39cc-b1fd-4c03-8b97-8a423eade17a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:29 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 Apr 15 23:21:29 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:29 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e Apr 15 23:21:29 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:29 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" returned: 0 in 0.532s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:29 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e" returned: 0 in 0.503s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:29 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3 Apr 15 23:21:29 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:29 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e Apr 15 23:21:29 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:30 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2c618a64-04e4-4d7d-adbc-dd31377ab88e" returned: 0 in 0.607s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:30 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" returned: 0 in 0.631s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "cinder-quobyte-2c618a64-04e4-4d7d-adbc-dd31377ab88e" released by "delete_volume" :: held 1.151s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Lock "cinder-quobyte-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3" released by "delete_volume" :: held 1.232s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:30 devstack cinder-volume[82388]: WARNING cinder.quota [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:21:30 devstack cinder-volume[82388]: WARNING cinder.quota [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Created reservations ['0cf5060b-976c-4ad5-a5c5-0b327b0a3bc0', '8d89eff1-593d-41df-8674-bd2b4150d2e4', '11476e65-6af0-46aa-932d-8dcd080e6305', '4f13d77c-e4e7-493f-a9df-7488c7522c69'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Created reservations ['fbfebccd-dd14-4478-9239-e9c3446a2654', '3428d586-97b4-4e4d-b8a7-00bb094d743f', 'e2d42249-7d14-4d2d-870a-29d0340e34b0', 'abcfe22d-5621-49d6-8ca7-514bc40f0535'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:30 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:30 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:30 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:30 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:31 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.436s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:31 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Deleted volume successfully. Apr 15 23:21:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88577981-9d89-4887-b998-6d943de8ab88 tempest-VolumeRetypeWithoutMigrationTest-1915186867 None] Lock "cinder-2c618a64-04e4-4d7d-adbc-dd31377ab88e-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:31 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.448s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:31 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Deleted volume successfully. Apr 15 23:21:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e7b22ffe-8831-4a19-853c-1644fd6c8471 tempest-VolumesActionsTest-831974169 None] Lock "cinder-3c4b3f28-8056-43b2-bb9f-cf1ce1a2b3d3-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Flow 'volume_create_manager' (82081252-922f-4373-93eb-14bce89770f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35da3915-6be8-47d2-a5af-5cc5d85dda01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35da3915-6be8-47d2-a5af-5cc5d85dda01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1132872913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38531bb8-af14-4470-97d6-0af868061a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62abf92f24d41ff97e5804847d45189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:35Z,use_quota=True,user_id='81559d134a7d45f39c71a64e70164df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c35f032-f590-4023-ac9d-149144020405),volume_type_id=5c35f032-f590-4023-ac9d-149144020405)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b25d683-ccb4-4b42-b241-f72031ad4444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b25d683-ccb4-4b42-b241-f72031ad4444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cad0ab-a301-41dc-a68f-6e55533e8a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cad0ab-a301-41dc-a68f-6e55533e8a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38531bb8-af14-4470-97d6-0af868061a76', 'volume_name': 'volume-38531bb8-af14-4470-97d6-0af868061a76', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f274527-0dfd-41d3-aa83-0728a8a93e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f274527-0dfd-41d3-aa83-0728a8a93e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc5812f-4fd5-41aa-8822-36bae9d8dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:35 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Volume 38531bb8-af14-4470-97d6-0af868061a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38531bb8-af14-4470-97d6-0af868061a76', 'volume_size': 1} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1132872913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38531bb8-af14-4470-97d6-0af868061a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62abf92f24d41ff97e5804847d45189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:35Z,use_quota=True,user_id='81559d134a7d45f39c71a64e70164df1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c35f032-f590-4023-ac9d-149144020405),volume_type_id=5c35f032-f590-4023-ac9d-149144020405)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Creating volume 38531bb8-af14-4470-97d6-0af868061a76 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:35 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:35 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 1073741824 Apr 15 23:21:35 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:36 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 1073741824" returned: 0 in 0.615s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:36 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 Apr 15 23:21:36 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:36 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76" returned: 0 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc5812f-4fd5-41aa-8822-36bae9d8dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38531bb8-af14-4470-97d6-0af868061a76', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb4d41b-1e99-4ebd-b422-f65600715ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:36 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Volume volume-38531bb8-af14-4470-97d6-0af868061a76 (38531bb8-af14-4470-97d6-0af868061a76): created successfully Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb4d41b-1e99-4ebd-b422-f65600715ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Flow 'volume_create_manager' (82081252-922f-4373-93eb-14bce89770f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5ce64860-e492-4953-bf2e-11c12b85544e tempest-VolumeTypesAccessTest-1026260278 None] Created volume successfully. Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Acquiring lock "cinder-38531bb8-af14-4470-97d6-0af868061a76-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Lock "cinder-38531bb8-af14-4470-97d6-0af868061a76-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Acquiring lock "cinder-quobyte-38531bb8-af14-4470-97d6-0af868061a76" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Lock "cinder-quobyte-38531bb8-af14-4470-97d6-0af868061a76" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e284d9-c17f-4bf8-9316-ed90c7515fbb]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (6bee5de5-9981-47eb-973b-180d3ce9086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1bad3f-4794-4651-8b7c-9b3c8db6b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1bad3f-4794-4651-8b7c-9b3c8db6b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-67490268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ee3010-fb89-4137-9f48-3fcea2854e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:38Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86973dd6-fe36-41fd-b5fe-f385bde592e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86973dd6-fe36-41fd-b5fe-f385bde592e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61524fb-5d5b-497a-bd78-5617766fcc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:37 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61524fb-5d5b-497a-bd78-5617766fcc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ee3010-fb89-4137-9f48-3fcea2854e95', 'volume_name': 'volume-c9ee3010-fb89-4137-9f48-3fcea2854e95', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:37 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccafa901-3000-4573-aaa4-f7f208ad94ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccafa901-3000-4573-aaa4-f7f208ad94ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7729e69-f7d2-4f75-be44-e102718c6c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:37 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Volume c9ee3010-fb89-4137-9f48-3fcea2854e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ee3010-fb89-4137-9f48-3fcea2854e95', 'volume_size': 1} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-67490268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ee3010-fb89-4137-9f48-3fcea2854e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:38Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Creating volume c9ee3010-fb89-4137-9f48-3fcea2854e95 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:37 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:37 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 1073741824 Apr 15 23:21:37 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:38 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76" returned: 0 in 0.509s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:38 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76 Apr 15 23:21:38 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-a8745f1a-198a-4618-adbd-8b7d7dbcca90 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Terminate volume connection completed successfully. Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-a8745f1a-198a-4618-adbd-8b7d7dbcca90 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Deleting attachment f8d1d4f0-ef4b-4ae6-822b-52b08e6d0a0c. {{(pid=82388) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 23:21:38 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 1073741824" returned: 0 in 0.526s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:38 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 Apr 15 23:21:38 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:38 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-38531bb8-af14-4470-97d6-0af868061a76" returned: 0 in 0.450s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Lock "cinder-quobyte-38531bb8-af14-4470-97d6-0af868061a76" released by "delete_volume" :: held 1.026s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:38 devstack cinder-volume[82388]: WARNING cinder.quota [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1686568840 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1686568840, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:21:38 devstack cinder-volume[82388]: WARNING cinder.quota [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1686568840 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1686568840, it is now deprecated. Please use the default quota class for default quota. Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Created reservations ['0a9d01b6-73c2-42de-a4dd-24f5c01635f3', 'ddc8acbe-5cfe-439a-81ae-0cf5667a00a6', 'a46d7ee6-8bfa-4e7e-b41a-233e775203e4', '4874e026-3d83-4241-8b63-89958a50f364'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:38 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:38 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:38 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7729e69-f7d2-4f75-be44-e102718c6c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ee3010-fb89-4137-9f48-3fcea2854e95', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a488b0f1-b18a-438a-ac62-f601cdad3b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:38 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Volume volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 (c9ee3010-fb89-4137-9f48-3fcea2854e95): created successfully Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a488b0f1-b18a-438a-ac62-f601cdad3b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (6bee5de5-9981-47eb-973b-180d3ce9086f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e4545c79-a727-4403-8b02-e6ea379da75f tempest-VolumesActionsTest-831974169 None] Created volume successfully. Apr 15 23:21:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "cinder-b73c4d30-d73f-4a34-89e2-92031463d3dc-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-b73c4d30-d73f-4a34-89e2-92031463d3dc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "cinder-quobyte-b73c4d30-d73f-4a34-89e2-92031463d3dc" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-quobyte-b73c4d30-d73f-4a34-89e2-92031463d3dc" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9586b6-68de-4d94-bc55-5b84927e9644]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:39 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc Apr 15 23:21:39 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:39 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.403s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:39 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Deleted volume successfully. Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-36d6b76e-b88e-4fd7-8995-cb7335e55eee tempest-VolumeTypesAccessTest-1026260278 None] Lock "cinder-38531bb8-af14-4470-97d6-0af868061a76-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:39 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:39 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc Apr 15 23:21:39 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-c9ee3010-fb89-4137-9f48-3fcea2854e95-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Lock "cinder-c9ee3010-fb89-4137-9f48-3fcea2854e95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-quobyte-c9ee3010-fb89-4137-9f48-3fcea2854e95" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:40 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b73c4d30-d73f-4a34-89e2-92031463d3dc" returned: 0 in 0.494s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-c9ee3010-fb89-4137-9f48-3fcea2854e95" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d56246-e65b-4fe7-b693-304b43da6953]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-quobyte-b73c4d30-d73f-4a34-89e2-92031463d3dc" released by "delete_volume" :: held 1.032s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.quota [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Created reservations ['b639353c-9add-4e26-a294-47fb02263c24', '5dda0417-3ec4-4e9c-a80f-8785b814dc45', '3c8d71f2-4c1d-45a3-b78f-478bfa0bb993', '5557ce09-a38d-444b-9323-0d71a5d061a2'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:40 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 Apr 15 23:21:40 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:40 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:40 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:40 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95" returned: 0 in 0.585s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:40 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95 Apr 15 23:21:40 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:40 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.manager [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Deleted volume successfully. Apr 15 23:21:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-c7b33c24-371c-4fe1-ae76-dfbc58ca2375 req-7851d73a-e38d-4c5a-bb3c-2e1d73f864f2 tempest-ServerBootFromVolumeStableRescueTest-489057306 None] Lock "cinder-b73c4d30-d73f-4a34-89e2-92031463d3dc-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:41 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c9ee3010-fb89-4137-9f48-3fcea2854e95" returned: 0 in 0.498s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-c9ee3010-fb89-4137-9f48-3fcea2854e95" released by "delete_volume" :: held 1.109s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Created reservations ['a5a3919d-21bf-4778-919f-4e8f1c66378a', 'f6f4adef-3b26-4b65-bf3a-7a3180ebbb95', '38c9692e-e516-4f2c-9e73-0e8aa9a8dad1', '92748232-f3a7-4bbe-a31c-900f1cd6f175'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=102,cinder:DELETE=8,cinder:UPDATE=94,cinder:INSERT=28 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:41 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:41 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:41 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:41 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Deleted volume successfully. Apr 15 23:21:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd46b299-1b54-4763-934c-ae04dbf84a78 tempest-VolumesActionsTest-294358715 None] Lock "cinder-c9ee3010-fb89-4137-9f48-3fcea2854e95-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (27d82d82-4e0f-4006-8fb0-25b70febeb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a1a344-1663-4c39-be34-23a9951d83a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a1a344-1663-4c39-be34-23a9951d83a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-993290510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4670b02-e53a-44e8-92b9-3745b221ac64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:43Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020da77b-87b3-4edd-a115-d6bd1c9bf4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020da77b-87b3-4edd-a115-d6bd1c9bf4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3412beda-f5ec-4f8a-b18c-5e0e35075f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3412beda-f5ec-4f8a-b18c-5e0e35075f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4670b02-e53a-44e8-92b9-3745b221ac64', 'volume_name': 'volume-c4670b02-e53a-44e8-92b9-3745b221ac64', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c4ebab-70e7-460e-a4fe-d1997aa71cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c4ebab-70e7-460e-a4fe-d1997aa71cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9a02b0-08f4-4ee2-a4ef-f51c1cf01681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:42 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Volume c4670b02-e53a-44e8-92b9-3745b221ac64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4670b02-e53a-44e8-92b9-3745b221ac64', 'volume_size': 1} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-993290510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4670b02-e53a-44e8-92b9-3745b221ac64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:43Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Creating volume c4670b02-e53a-44e8-92b9-3745b221ac64 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:42 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:42 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 1073741824 Apr 15 23:21:42 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:43 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 1073741824" returned: 0 in 0.592s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:43 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 Apr 15 23:21:43 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:43 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64" returned: 0 in 0.589s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9a02b0-08f4-4ee2-a4ef-f51c1cf01681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4670b02-e53a-44e8-92b9-3745b221ac64', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210ad0ed-8c04-4127-9a0d-4e164eb9a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:43 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Volume volume-c4670b02-e53a-44e8-92b9-3745b221ac64 (c4670b02-e53a-44e8-92b9-3745b221ac64): created successfully Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210ad0ed-8c04-4127-9a0d-4e164eb9a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (27d82d82-4e0f-4006-8fb0-25b70febeb40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:43 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1d6d4c84-18f2-411a-a074-efbd3cb501fc tempest-VolumesActionsTest-831974169 None] Created volume successfully. Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Flow 'volume_create_manager' (de91f231-9c6a-485d-b7f5-9bda8bb6cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad9c875-f9b0-4861-aafb-14fcd6718092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad9c875-f9b0-4861-aafb-14fcd6718092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1904865312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd77321-202e-46f7-bb28-2afa80c4bfdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db436327ae640ca99417dd99d59c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:44Z,use_quota=True,user_id='7b111ad8cd044932a4511d0a7d5a34a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6247effd-6f27-4f53-9df1-0524576467a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6247effd-6f27-4f53-9df1-0524576467a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2134fa1f-4418-48f0-bee5-d685c5d2a9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2134fa1f-4418-48f0-bee5-d685c5d2a9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd77321-202e-46f7-bb28-2afa80c4bfdd', 'volume_name': 'volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d1e3bd-725b-4a52-935b-4a3661855b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d1e3bd-725b-4a52-935b-4a3661855b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320b2a4c-fa39-4b9e-ba00-11060b71c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:44 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Volume 9cd77321-202e-46f7-bb28-2afa80c4bfdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd', 'volume_size': 1} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1904865312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd77321-202e-46f7-bb28-2afa80c4bfdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db436327ae640ca99417dd99d59c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:44Z,use_quota=True,user_id='7b111ad8cd044932a4511d0a7d5a34a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Creating volume 9cd77321-202e-46f7-bb28-2afa80c4bfdd {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:44 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:44 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd 1073741824 Apr 15 23:21:44 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-c4670b02-e53a-44e8-92b9-3745b221ac64-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Lock "cinder-c4670b02-e53a-44e8-92b9-3745b221ac64-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-quobyte-c4670b02-e53a-44e8-92b9-3745b221ac64" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-c4670b02-e53a-44e8-92b9-3745b221ac64" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d347d1-f6c2-44d9-b7d3-58937bc6fb7f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:44 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd 1073741824" returned: 0 in 0.613s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:45 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd Apr 15 23:21:45 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:45 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 Apr 15 23:21:45 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:45 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd" returned: 0 in 0.429s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320b2a4c-fa39-4b9e-ba00-11060b71c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96282b7-61bb-404f-96f6-a464426b6ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:45 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Volume volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd (9cd77321-202e-46f7-bb28-2afa80c4bfdd): created successfully Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96282b7-61bb-404f-96f6-a464426b6ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Flow 'volume_create_manager' (de91f231-9c6a-485d-b7f5-9bda8bb6cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:45 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b48e2f36-6634-4e5f-9e82-4872e2cecf4c tempest-VolumesListAdminTestJSON-1589590052 None] Created volume successfully. Apr 15 23:21:45 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64" returned: 0 in 0.565s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:45 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64 Apr 15 23:21:45 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:45 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c4670b02-e53a-44e8-92b9-3745b221ac64" returned: 0 in 0.410s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-c4670b02-e53a-44e8-92b9-3745b221ac64" released by "delete_volume" :: held 1.017s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:45 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Created reservations ['dda2877f-3ac7-4acc-b437-a27f44b86d88', 'd67abf77-61ff-4870-85a1-08be2cdd59c2', 'faa9f5c4-cb54-44c4-8678-8883110335a2', 'b6fbfcc5-ebbd-4e15-a175-3607cab8eb96'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:46 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:46 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:46 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.460s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:46 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Deleted volume successfully. Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4ecde40b-f927-4565-b5cd-b903128e96e2 tempest-VolumesActionsTest-294358715 None] Lock "cinder-c4670b02-e53a-44e8-92b9-3745b221ac64-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Flow 'volume_create_manager' (eb24184b-7d38-4f9c-8c5c-ee58a10f12ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2f297f-8aae-487e-b82c-3a57e33fbe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2f297f-8aae-487e-b82c-3a57e33fbe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1291901529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abddeb29-dba5-4e53-aa63-5841330a2335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db436327ae640ca99417dd99d59c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:47Z,use_quota=True,user_id='7b111ad8cd044932a4511d0a7d5a34a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d715a2c6-92e8-47be-ac59-42a537c25ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d715a2c6-92e8-47be-ac59-42a537c25ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f06f517-bc30-4b48-80e9-6e8452aa8920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f06f517-bc30-4b48-80e9-6e8452aa8920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abddeb29-dba5-4e53-aa63-5841330a2335', 'volume_name': 'volume-abddeb29-dba5-4e53-aa63-5841330a2335', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9634c08-1f23-49a1-8c2d-c3c8f93b5ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9634c08-1f23-49a1-8c2d-c3c8f93b5ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9f73aa-1ffc-4f99-889d-ecada86f14c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:46 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Volume abddeb29-dba5-4e53-aa63-5841330a2335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abddeb29-dba5-4e53-aa63-5841330a2335', 'volume_size': 1} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1291901529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abddeb29-dba5-4e53-aa63-5841330a2335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db436327ae640ca99417dd99d59c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:47Z,use_quota=True,user_id='7b111ad8cd044932a4511d0a7d5a34a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Creating volume abddeb29-dba5-4e53-aa63-5841330a2335 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:46 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:46 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 1073741824 Apr 15 23:21:46 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (40e4e6f1-bbbd-4c9f-b766-2ae3034cc8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96212f82-b991-4a9a-bcb7-37e2483f3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96212f82-b991-4a9a-bcb7-37e2483f3337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788339949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcffef0-6fbe-4234-9c7a-70a2a372adf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:47Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c42f8a3-a154-459e-a093-dcc7530e7616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c42f8a3-a154-459e-a093-dcc7530e7616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4069a70-41f4-4018-94b3-38fcd0977467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4069a70-41f4-4018-94b3-38fcd0977467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbcffef0-6fbe-4234-9c7a-70a2a372adf0', 'volume_name': 'volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e0e228-c029-4bb9-a3ee-d1d16f827acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e0e228-c029-4bb9-a3ee-d1d16f827acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d20ebcf-5ed7-4904-ab8b-5f8506e9c2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:47 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Volume cbcffef0-6fbe-4234-9c7a-70a2a372adf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0', 'volume_size': 1} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:47 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 1073741824" returned: 0 in 0.538s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:47 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 Apr 15 23:21:47 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:47 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335" returned: 0 in 0.462s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788339949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcffef0-6fbe-4234-9c7a-70a2a372adf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:47Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Creating volume cbcffef0-6fbe-4234-9c7a-70a2a372adf0 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:47 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:47 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 1073741824 Apr 15 23:21:47 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9f73aa-1ffc-4f99-889d-ecada86f14c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abddeb29-dba5-4e53-aa63-5841330a2335', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cb2f89-c126-4860-975e-f6148660d30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:48 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Volume volume-abddeb29-dba5-4e53-aa63-5841330a2335 (abddeb29-dba5-4e53-aa63-5841330a2335): created successfully Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cb2f89-c126-4860-975e-f6148660d30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Flow 'volume_create_manager' (eb24184b-7d38-4f9c-8c5c-ee58a10f12ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:48 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dcb701f9-cee6-402a-ac5d-bdd7336a32db tempest-VolumesListAdminTestJSON-1589590052 None] Created volume successfully. Apr 15 23:21:48 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 1073741824" returned: 0 in 0.520s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:48 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 Apr 15 23:21:48 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:48 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0" returned: 0 in 0.461s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d20ebcf-5ed7-4904-ab8b-5f8506e9c2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619eecb3-e2c8-456e-a936-4bb4280b57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:48 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Volume volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 (cbcffef0-6fbe-4234-9c7a-70a2a372adf0): created successfully Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619eecb3-e2c8-456e-a936-4bb4280b57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (40e4e6f1-bbbd-4c9f-b766-2ae3034cc8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:49 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ff99b87c-eb82-4749-9644-727dd2c37e61 tempest-VolumesActionsTest-831974169 None] Created volume successfully. Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Flow 'volume_create_manager' (b1c7f197-16b5-4bf3-ac4b-32ae07b4a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fb69d5-99ea-4d23-8b85-513cba23ec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fb69d5-99ea-4d23-8b85-513cba23ec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1522888448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5718eb6-1815-445b-bf2f-d11b8adfcfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db436327ae640ca99417dd99d59c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:49Z,use_quota=True,user_id='7b111ad8cd044932a4511d0a7d5a34a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665a2961-024d-4d9e-aff4-1f54046cc820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665a2961-024d-4d9e-aff4-1f54046cc820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8d6b61-2658-4ff5-b022-c151f6b60c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8d6b61-2658-4ff5-b022-c151f6b60c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5718eb6-1815-445b-bf2f-d11b8adfcfb2', 'volume_name': 'volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca4a5c0-7405-40ee-af16-6c010f165dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca4a5c0-7405-40ee-af16-6c010f165dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b87b97-3d6f-45c9-8f3b-efb7b2a87e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:49 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Volume a5718eb6-1815-445b-bf2f-d11b8adfcfb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2', 'volume_size': 1} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1522888448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5718eb6-1815-445b-bf2f-d11b8adfcfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db436327ae640ca99417dd99d59c003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:49Z,use_quota=True,user_id='7b111ad8cd044932a4511d0a7d5a34a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Creating volume a5718eb6-1815-445b-bf2f-d11b8adfcfb2 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:49 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:49 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 1073741824 Apr 15 23:21:49 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-cbcffef0-6fbe-4234-9c7a-70a2a372adf0-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Lock "cinder-cbcffef0-6fbe-4234-9c7a-70a2a372adf0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-quobyte-cbcffef0-6fbe-4234-9c7a-70a2a372adf0" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-cbcffef0-6fbe-4234-9c7a-70a2a372adf0" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b53cbc5-0fe6-4045-bc07-07685deb404b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:49 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 Apr 15 23:21:49 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:49 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 1073741824" returned: 0 in 0.592s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:49 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 Apr 15 23:21:49 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:50 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0" returned: 0 in 0.562s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:50 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0 Apr 15 23:21:50 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:50 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2" returned: 0 in 0.489s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b87b97-3d6f-45c9-8f3b-efb7b2a87e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848c225a-e7b0-4df7-bcc1-0b7488d5f539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:50 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Volume volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 (a5718eb6-1815-445b-bf2f-d11b8adfcfb2): created successfully Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848c225a-e7b0-4df7-bcc1-0b7488d5f539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Flow 'volume_create_manager' (b1c7f197-16b5-4bf3-ac4b-32ae07b4a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:50 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-09541db3-24b7-4086-b2a0-f8d26ba781f5 tempest-VolumesListAdminTestJSON-1589590052 None] Created volume successfully. Apr 15 23:21:50 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cbcffef0-6fbe-4234-9c7a-70a2a372adf0" returned: 0 in 0.507s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-cbcffef0-6fbe-4234-9c7a-70a2a372adf0" released by "delete_volume" :: held 1.091s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Created reservations ['5898b866-e9a0-4617-83b3-90e6df7a0ea9', '6d35f104-9894-4d77-bb9c-3c40b96498d3', '9194237a-f645-4ff7-bc5d-8db5460c7ac5', 'ed6e3cf7-793d-4555-9a91-abb74d314eb2'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:50 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:50 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:51 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:51 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:51 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Deleted volume successfully. Apr 15 23:21:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b8720d04-9bcb-41ec-9f79-668e77103638 tempest-VolumesActionsTest-294358715 None] Lock "cinder-cbcffef0-6fbe-4234-9c7a-70a2a372adf0-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (7c384f1d-6fb1-4de7-971f-4f0456fb6126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cacf03-f0fb-4722-95c5-ee32de839949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cacf03-f0fb-4722-95c5-ee32de839949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538978128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84eb0fe3-8cee-4d51-bb5f-1167073605ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:52Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd215be9-89c8-4d53-828b-dbf6e3da509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd215be9-89c8-4d53-828b-dbf6e3da509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0013c71-1edc-411c-a528-c97283403ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0013c71-1edc-411c-a528-c97283403ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84eb0fe3-8cee-4d51-bb5f-1167073605ba', 'volume_name': 'volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf98579-7d6a-4fa1-9318-6fc9cb49d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf98579-7d6a-4fa1-9318-6fc9cb49d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcfe245-573d-4f36-9230-451ed6d64f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Volume 84eb0fe3-8cee-4d51-bb5f-1167073605ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba', 'volume_size': 1} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-538978128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84eb0fe3-8cee-4d51-bb5f-1167073605ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:52Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Creating volume 84eb0fe3-8cee-4d51-bb5f-1167073605ba {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:52 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=151,cinder:DELETE=10,cinder:SELECT=115,cinder:INSERT=41 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:21:52 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba 1073741824 Apr 15 23:21:52 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Flow 'volume_create_manager' (b2521073-2758-4590-9277-1cad0fbe9b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f36bc54-2b15-4e3e-836f-318b231b62ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f36bc54-2b15-4e3e-836f-318b231b62ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616664f6-850f-45a8-8660-74c6cc56a7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bc4eb2820f458f87d106d0a92f4575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:52Z,use_quota=True,user_id='3b105f71ad894471a595f2a66b2af2dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b3c102-d46a-4bf1-80d7-22d91b0a8225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b3c102-d46a-4bf1-80d7-22d91b0a8225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65d93c5-8c17-4cf5-8d8f-6e8b75cfbbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65d93c5-8c17-4cf5-8d8f-6e8b75cfbbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616664f6-850f-45a8-8660-74c6cc56a7ef', 'volume_name': 'volume-616664f6-850f-45a8-8660-74c6cc56a7ef', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2963f680-c84d-4338-86be-7074635e8793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2963f680-c84d-4338-86be-7074635e8793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aea468d-cd55-47c4-a36f-4423f3a0d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:52 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Volume 616664f6-850f-45a8-8660-74c6cc56a7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616664f6-850f-45a8-8660-74c6cc56a7ef', 'volume_size': 1} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:52 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba 1073741824" returned: 0 in 0.540s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:52 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba Apr 15 23:21:52 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Flow 'volume_create_manager' (18efcd8a-9099-4bcc-8165-49c4f679a4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7dce4f-1fae-4319-9a73-99ba175f48e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7dce4f-1fae-4319-9a73-99ba175f48e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-506448899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7995916-108b-44f5-bad4-5fc9e97df6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a5b9da7ca44ee08d5daefb7c2cfbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:53Z,use_quota=True,user_id='951452722303483f9de9ec3edef9b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dfe2bb-0bbc-4fdf-91f3-0f8eeb731f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dfe2bb-0bbc-4fdf-91f3-0f8eeb731f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a8382e-efaf-4986-8197-f2b6678f7bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a8382e-efaf-4986-8197-f2b6678f7bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7995916-108b-44f5-bad4-5fc9e97df6ab', 'volume_name': 'volume-c7995916-108b-44f5-bad4-5fc9e97df6ab', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786dd7b-f2c1-410f-8221-cb8c61d6f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786dd7b-f2c1-410f-8221-cb8c61d6f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35b964d-5c5c-435f-a05e-bc72cb75008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:53 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Volume c7995916-108b-44f5-bad4-5fc9e97df6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7995916-108b-44f5-bad4-5fc9e97df6ab', 'volume_size': 1} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:53 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba" returned: 0 in 0.482s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616664f6-850f-45a8-8660-74c6cc56a7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bc4eb2820f458f87d106d0a92f4575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:52Z,use_quota=True,user_id='3b105f71ad894471a595f2a66b2af2dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Creating volume 616664f6-850f-45a8-8660-74c6cc56a7ef {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:53 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcfe245-573d-4f36-9230-451ed6d64f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cd823b-2247-4176-a48a-a60b601e4c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:53 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef 1073741824 Apr 15 23:21:53 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:53 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Volume volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba (84eb0fe3-8cee-4d51-bb5f-1167073605ba): created successfully Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cd823b-2247-4176-a48a-a60b601e4c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (7c384f1d-6fb1-4de7-971f-4f0456fb6126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:53 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dd214af4-b43c-4403-b232-7bb598d6c838 tempest-VolumesActionsTest-831974169 None] Created volume successfully. Apr 15 23:21:53 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef 1073741824" returned: 0 in 0.503s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:53 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef Apr 15 23:21:53 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:54 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.101s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-506448899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7995916-108b-44f5-bad4-5fc9e97df6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49a5b9da7ca44ee08d5daefb7c2cfbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:53Z,use_quota=True,user_id='951452722303483f9de9ec3edef9b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Creating volume c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:54 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aea468d-cd55-47c4-a36f-4423f3a0d753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616664f6-850f-45a8-8660-74c6cc56a7ef', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232cc0a2-f1ab-46d9-884e-de87b8f42a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:54 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab 1073741824 Apr 15 23:21:54 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:54 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Volume volume-616664f6-850f-45a8-8660-74c6cc56a7ef (616664f6-850f-45a8-8660-74c6cc56a7ef): created successfully Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232cc0a2-f1ab-46d9-884e-de87b8f42a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Flow 'volume_create_manager' (b2521073-2758-4590-9277-1cad0fbe9b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4b386d53-3a96-4f09-9db6-12386ac14482 tempest-VolumesListAdminTestJSON-294416259 None] Created volume successfully. Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-84eb0fe3-8cee-4d51-bb5f-1167073605ba-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Lock "cinder-84eb0fe3-8cee-4d51-bb5f-1167073605ba-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Acquiring lock "cinder-quobyte-84eb0fe3-8cee-4d51-bb5f-1167073605ba" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-84eb0fe3-8cee-4d51-bb5f-1167073605ba" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[711d87b4-784b-462a-b99b-aa38907a9167]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:54 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba Apr 15 23:21:54 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:54 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab 1073741824" returned: 0 in 0.558s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:54 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab Apr 15 23:21:54 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:54 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba" returned: 0 in 0.506s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:54 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba Apr 15 23:21:54 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:55 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab" returned: 0 in 0.447s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35b964d-5c5c-435f-a05e-bc72cb75008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7995916-108b-44f5-bad4-5fc9e97df6ab', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528bb3b4-6772-46a2-8653-6954c43d19a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:55 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Volume volume-c7995916-108b-44f5-bad4-5fc9e97df6ab (c7995916-108b-44f5-bad4-5fc9e97df6ab): created successfully Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528bb3b4-6772-46a2-8653-6954c43d19a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Flow 'volume_create_manager' (18efcd8a-9099-4bcc-8165-49c4f679a4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:55 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-84eb0fe3-8cee-4d51-bb5f-1167073605ba" returned: 0 in 0.419s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Lock "cinder-quobyte-84eb0fe3-8cee-4d51-bb5f-1167073605ba" released by "delete_volume" :: held 0.951s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:55 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-41cd9148-e580-4a71-b3c6-7a802467419e req-82dc6ecc-8395-4c19-a4bd-462c83d359d4 tempest-VolumesSnapshotsTestJSON-50659848 None] Created volume successfully. Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Created reservations ['271e2bd3-bec1-4488-a164-4c244b485e52', '0b7fd27b-96ee-461f-920b-1d8626533f31', '24f6ddf0-a87e-4c5b-acd3-2bf7dd640e61', 'c155e206-bb7d-4d0a-b997-0cb3d42f1b61'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Acquiring lock "cinder-616664f6-850f-45a8-8660-74c6cc56a7ef-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:55 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:55 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Lock "cinder-616664f6-850f-45a8-8660-74c6cc56a7ef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Acquiring lock "cinder-quobyte-616664f6-850f-45a8-8660-74c6cc56a7ef" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Lock "cinder-quobyte-616664f6-850f-45a8-8660-74c6cc56a7ef" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf05dbf-abc4-4f89-8527-4dad0c835633]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "cinder-a5718eb6-1815-445b-bf2f-d11b8adfcfb2-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-a5718eb6-1815-445b-bf2f-d11b8adfcfb2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "cinder-quobyte-a5718eb6-1815-445b-bf2f-d11b8adfcfb2" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-quobyte-a5718eb6-1815-445b-bf2f-d11b8adfcfb2" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dc1196-f168-4368-83f5-f04628e664c9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:55 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef Apr 15 23:21:55 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:55 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 Apr 15 23:21:55 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (617555f9-f15e-4d04-9ae8-e847e8fc3387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f1d2fa-96e6-435f-a02c-7762de79a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f1d2fa-96e6-435f-a02c-7762de79a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-135554594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d9e823-acf5-4f6d-91b6-0e8815984f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:56Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e1dce-33e4-4ddd-bf33-5d05ca64b0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e1dce-33e4-4ddd-bf33-5d05ca64b0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702eb512-325b-40a0-bf3c-b776dd494476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702eb512-325b-40a0-bf3c-b776dd494476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d9e823-acf5-4f6d-91b6-0e8815984f0d', 'volume_name': 'volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881c7412-cda5-47aa-a41f-07966e88c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881c7412-cda5-47aa-a41f-07966e88c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6d70fe-8c5e-4b95-966d-3554a019b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:55 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Volume b4d9e823-acf5-4f6d-91b6-0e8815984f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d', 'volume_size': 1} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-135554594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d9e823-acf5-4f6d-91b6-0e8815984f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6004bea7549487f9da134c05da4b920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:21:56Z,use_quota=True,user_id='ba56fbc9bc0c4592bbf50773c063e386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Creating volume b4d9e823-acf5-4f6d-91b6-0e8815984f0d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:21:55 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:55 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d 1073741824 Apr 15 23:21:55 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:55 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.499s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:55 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Deleted volume successfully. Apr 15 23:21:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d005ca72-582b-493d-b14a-8d5a7a957c61 tempest-VolumesActionsTest-294358715 None] Lock "cinder-84eb0fe3-8cee-4d51-bb5f-1167073605ba-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:56 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef" returned: 0 in 0.604s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:56 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef Apr 15 23:21:56 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:56 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2" returned: 0 in 0.577s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:56 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2 Apr 15 23:21:56 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:56 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d 1073741824" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:56 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d Apr 15 23:21:56 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:56 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-616664f6-850f-45a8-8660-74c6cc56a7ef" returned: 0 in 0.448s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Lock "cinder-quobyte-616664f6-850f-45a8-8660-74c6cc56a7ef" released by "delete_volume" :: held 1.079s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Created reservations ['9b2d9527-3930-489d-a402-e40da2dff835', '6b5f597d-f98a-4ae1-813f-6ee034c0c4a3', '8f981bf5-85b1-48f2-9c0e-cc6df1965793', 'f82201a6-df2d-4846-8b9f-9f373982becc'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:56 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:56 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:56 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a5718eb6-1815-445b-bf2f-d11b8adfcfb2" returned: 0 in 0.615s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-quobyte-a5718eb6-1815-445b-bf2f-d11b8adfcfb2" released by "delete_volume" :: held 1.217s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:56 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Created reservations ['872e8a5a-b72b-4535-bf68-b853550f5c5d', '18ff4379-ff65-45a1-bae7-ee86c855dc79', '8cb09595-2852-40f2-b69d-e7425e7f160a', '6971fef1-fa71-4012-9df6-5fd0d1dba56d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d" returned: 0 in 0.505s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.290s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6d70fe-8c5e-4b95-966d-3554a019b394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab58c61-2f28-4f13-9a35-1aa582cca732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:56 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Volume volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d (b4d9e823-acf5-4f6d-91b6-0e8815984f0d): created successfully Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab58c61-2f28-4f13-9a35-1aa582cca732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:21:56 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Flow 'volume_create_manager' (617555f9-f15e-4d04-9ae8-e847e8fc3387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:21:56 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Creating offline snapshot 38d7ab61-2c80-490d-a72f-65dd9e1e1454 of volume c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:21:56 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7422c3d1-f746-4667-bba9-6817ccd32248 tempest-VolumesActionsTest-831974169 None] Created volume successfully. Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b85ab9c-13e0-4772-94ca-b01ec148e705]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:57 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab Apr 15 23:21:57 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:57 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.501s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:57 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Deleted volume successfully. Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-43e0aa89-e52b-4cde-8bcd-599f54e713d5 tempest-VolumesListAdminTestJSON-294416259 None] Lock "cinder-616664f6-850f-45a8-8660-74c6cc56a7ef-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:57 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:57 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Deleted volume successfully. Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7c5aa8bd-2db1-4412-98e4-af17313be7d3 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-a5718eb6-1815-445b-bf2f-d11b8adfcfb2-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:57 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:57 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 1G Apr 15 23:21:57 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "cinder-abddeb29-dba5-4e53-aa63-5841330a2335-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-abddeb29-dba5-4e53-aa63-5841330a2335-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "cinder-quobyte-abddeb29-dba5-4e53-aa63-5841330a2335" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-quobyte-abddeb29-dba5-4e53-aa63-5841330a2335" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[497224f2-4462-4917-be8f-61e17424a951]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:57 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 Apr 15 23:21:57 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:57 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 1G" returned: 0 in 0.517s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7995916-108b-44f5-bad4-5fc9e97df6ab -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:57 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7995916-108b-44f5-bad4-5fc9e97df6ab -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 Apr 15 23:21:57 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Acquiring lock "cinder-b4d9e823-acf5-4f6d-91b6-0e8815984f0d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Lock "cinder-b4d9e823-acf5-4f6d-91b6-0e8815984f0d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Acquiring lock "cinder-quobyte-b4d9e823-acf5-4f6d-91b6-0e8815984f0d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Lock "cinder-quobyte-b4d9e823-acf5-4f6d-91b6-0e8815984f0d" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[217bfb3a-ad14-4456-bcae-d72d5aed7efc]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:58 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335" returned: 0 in 0.602s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:58 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d Apr 15 23:21:58 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:58 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335 Apr 15 23:21:58 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:58 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7995916-108b-44f5-bad4-5fc9e97df6ab -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454" returned: 0 in 0.567s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:58 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 is being set with open permissions: ugo+rw Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:58 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 Apr 15 23:21:58 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:58 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-abddeb29-dba5-4e53-aa63-5841330a2335" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-quobyte-abddeb29-dba5-4e53-aa63-5841330a2335" released by "delete_volume" :: held 1.085s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:58 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d" returned: 0 in 0.517s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:58 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d Apr 15 23:21:58 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Created reservations ['f899b454-ebf2-4947-bc03-71a19d1dfa55', 'dd5a393b-f693-48ed-95a4-3dc00c621a60', 'b14f57e7-2674-463d-8f89-05ceee81603e', '7e62bf71-d6d9-4d53-82a8-966ff20452b6'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:59 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:59 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:59 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454" returned: 0 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:59 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.info Apr 15 23:21:59 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:59 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-b4d9e823-acf5-4f6d-91b6-0e8815984f0d" returned: 0 in 0.434s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Lock "cinder-quobyte-b4d9e823-acf5-4f6d-91b6-0e8815984f0d" released by "delete_volume" :: held 0.978s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Created reservations ['e42dfe10-4720-40d9-85fe-7db38caf565e', '7b62640f-ce41-4fe3-a95c-86fa6defb780', '6f396f7f-eeef-42ea-bd19-9a387e98ead9', 'f6932b4a-d074-4471-8f06-45852fb10633'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:21:59 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:59 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:59 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Deleted volume successfully. Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.info" returned: 0 in 0.442s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:59 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.info is being set with open permissions: ugo+rw Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:21:59 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:21:59 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-51239d3d-bce3-47a2-b6f7-5e19c1b68e75 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-abddeb29-dba5-4e53-aa63-5841330a2335-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:59 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.info Apr 15 23:21:59 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:21:59 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.426s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:21:59 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Deleted volume successfully. Apr 15 23:21:59 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.info" returned: 0 in 0.422s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4211e307-c4b7-4e77-93d4-8405e79149fd tempest-VolumesActionsTest-831974169 None] Lock "cinder-b4d9e823-acf5-4f6d-91b6-0e8815984f0d-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:21:59 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-0a4c1408-3c76-47ce-91e2-c1aaf6c1619d req-37942950-20c1-478f-a44c-9204c5f091aa tempest-VolumesSnapshotsTestJSON-50659848 None] Create snapshot completed successfully Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "cinder-9cd77321-202e-46f7-bb28-2afa80c4bfdd-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:21:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-9cd77321-202e-46f7-bb28-2afa80c4bfdd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "cinder-quobyte-9cd77321-202e-46f7-bb28-2afa80c4bfdd" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-quobyte-9cd77321-202e-46f7-bb28-2afa80c4bfdd" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[556d9dd0-1d11-46d3-aedc-f64c6048b529]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:00 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd Apr 15 23:22:00 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:00 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd" returned: 0 in 0.498s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:00 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd Apr 15 23:22:00 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "cinder-38d7ab61-2c80-490d-a72f-65dd9e1e1454-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-38d7ab61-2c80-490d-a72f-65dd9e1e1454-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "cinder-quobyte-c7995916-108b-44f5-bad4-5fc9e97df6ab" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-quobyte-c7995916-108b-44f5-bad4-5fc9e97df6ab" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "cinder-quobyte-38d7ab61-2c80-490d-a72f-65dd9e1e1454" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:00 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-quobyte-38d7ab61-2c80-490d-a72f-65dd9e1e1454" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Deleting offline snapshot 38d7ab61-2c80-490d-a72f-65dd9e1e1454 of volume c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] snapshot_file for this snap is: volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9cd77321-202e-46f7-bb28-2afa80c4bfdd" returned: 0 in 0.492s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefebc71-a8bc-444a-92e0-3ec32d89ad4a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-quobyte-9cd77321-202e-46f7-bb28-2afa80c4bfdd" released by "delete_volume" :: held 1.032s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Created reservations ['f5a6bb77-0273-4370-b187-175d35cb5132', '6f6ad42b-c75e-4a96-91c4-213f5420367e', '593d7ed7-72e5-41c9-9bf1-c90234531065', '7c9e7b40-1799-4cfd-bd35-68cc4d4882ee'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:01 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 Apr 15 23:22:01 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:01 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:01 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:01 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.432s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Deleted volume successfully. Apr 15 23:22:01 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454" returned: 0 in 0.564s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7995916-108b-44f5-bad4-5fc9e97df6ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-491e9477-a1fb-4b1a-bfe3-c6ecca995b36 tempest-VolumesListAdminTestJSON-1589590052 None] Lock "cinder-9cd77321-202e-46f7-bb28-2afa80c4bfdd-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9118efd-1f65-4a63-9001-f686243a8bc8]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:01 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab Apr 15 23:22:01 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:02 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab" returned: 0 in 0.520s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:02 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 Apr 15 23:22:02 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:02 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454" returned: 0 in 0.593s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:02 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454 Apr 15 23:22:02 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:03 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab.38d7ab61-2c80-490d-a72f-65dd9e1e1454" returned: 0 in 0.565s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-quobyte-38d7ab61-2c80-490d-a72f-65dd9e1e1454" released by "_delete_snapshot" :: held 2.348s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-quobyte-c7995916-108b-44f5-bad4-5fc9e97df6ab" released by "delete_snapshot" :: held 2.394s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:03 devstack cinder-volume[82388]: DEBUG cinder.quota [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Created reservations ['65b0c83a-3093-4cdd-9af9-9195db1dc463', 'bbcc8725-fb38-4bd5-a1c3-e72ff00748c9', 'c5307981-0853-46fb-a75b-9d2656b6ba00', '3d54e8a1-c49f-4355-9570-4e368b313303'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:03 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Delete snapshot completed successfully. Apr 15 23:22:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-a04611ee-1777-4e0d-b9e3-fe5efd87312a req-d7125538-c3ae-46a6-83d4-7e4ed99c578a tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-38d7ab61-2c80-490d-a72f-65dd9e1e1454-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "cinder-c7995916-108b-44f5-bad4-5fc9e97df6ab-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-c7995916-108b-44f5-bad4-5fc9e97df6ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "cinder-quobyte-c7995916-108b-44f5-bad4-5fc9e97df6ab" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-quobyte-c7995916-108b-44f5-bad4-5fc9e97df6ab" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37d0933-79cc-4973-baaf-b671b5942a55]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:04 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab Apr 15 23:22:04 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:04 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab" returned: 0 in 0.581s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:04 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab Apr 15 23:22:04 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:05 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c7995916-108b-44f5-bad4-5fc9e97df6ab" returned: 0 in 0.554s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-quobyte-c7995916-108b-44f5-bad4-5fc9e97df6ab" released by "delete_volume" :: held 1.181s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.quota [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Created reservations ['5621a1c0-a66f-4206-8641-9afb03abe4ce', '92c386fd-900d-4a5f-912c-dc36cd8887cf', 'fe05af8c-8adf-4c40-9397-c2c5c534f403', '669731be-8b21-41ba-9a0d-34ea04e34dd5'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Flow 'volume_create_manager' (f4210a50-2f03-4a54-a3bd-f28f9f4ac1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1554ba-1780-4f0e-8048-87b08e225f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1554ba-1780-4f0e-8048-87b08e225f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1088611164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35632a268a09446ca83afba063b2ee7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:05Z,use_quota=True,user_id='fb5c6a60cbeb4e6985c8e1d99373df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd52650-27bc-4b11-aff5-7e3e5560c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd52650-27bc-4b11-aff5-7e3e5560c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c76dcf6-5255-4191-8611-29017d63264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c76dcf6-5255-4191-8611-29017d63264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e', 'volume_name': 'volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdef4597-dd15-4a53-ab9b-68f59d78b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdef4597-dd15-4a53-ab9b-68f59d78b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c4d4e1-7c37-49f8-85a2-27438d3b1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:05 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Volume a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e', 'volume_size': 1} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1088611164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35632a268a09446ca83afba063b2ee7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:05Z,use_quota=True,user_id='fb5c6a60cbeb4e6985c8e1d99373df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Creating volume a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:05 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:05 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e 1073741824 Apr 15 23:22:05 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:05 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:05 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:06 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG cinder.manager [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:06 devstack cinder-volume[82388]: INFO cinder.volume.manager [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Deleted volume successfully. Apr 15 23:22:06 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e 1073741824" returned: 0 in 0.570s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [req-3d238308-8005-42ae-b60c-d3e038465e55 req-a6f77556-6e26-486f-aa1c-f74f924cfe11 tempest-VolumesSnapshotsTestJSON-50659848 None] Lock "cinder-c7995916-108b-44f5-bad4-5fc9e97df6ab-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:06 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e Apr 15 23:22:06 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:06 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e" returned: 0 in 0.465s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c4d4e1-7c37-49f8-85a2-27438d3b1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfabca41-b108-48fe-9f27-e9ba35362f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:06 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Volume volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e (a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e): created successfully Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfabca41-b108-48fe-9f27-e9ba35362f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Flow 'volume_create_manager' (f4210a50-2f03-4a54-a3bd-f28f9f4ac1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:06 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ed0a47ec-8475-4f5a-8a56-fd5f70aab596 tempest-AbsoluteLimitsTests-1418554763 None] Created volume successfully. Apr 15 23:22:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Acquiring lock "cinder-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Lock "cinder-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Acquiring lock "cinder-quobyte-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Lock "cinder-quobyte-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:07 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fee023c-5a65-4267-9ac9-a554dacf6c2c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:07 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e Apr 15 23:22:07 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:08 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e" returned: 0 in 0.582s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:08 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e Apr 15 23:22:08 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:08 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e" returned: 0 in 0.525s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Lock "cinder-quobyte-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e" released by "delete_volume" :: held 1.132s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:08 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Created reservations ['ab169cc1-1576-40bc-9ef1-b8348768866f', '2c95176c-c442-486d-8ee8-37dea5e17232', '7ef40507-2267-45f6-b7b1-e3dd5f3694d9', 'f31d09c8-7d01-4052-8c11-67c9af799ce3'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:09 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:09 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Flow 'volume_create_manager' (5f147e1f-313b-411d-b929-c7bafe0d877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f2d244-3bfd-46d4-b7fa-9d744169f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f2d244-3bfd-46d4-b7fa-9d744169f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1673853542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3137860-9d87-4fcf-84ba-1c66213a0ca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f319f02fa83442479dc5109a728e439a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:09Z,use_quota=True,user_id='fddd3c71b32343859ebfbd3ba50d3b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22135546-5f64-47b3-8123-034f355976b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22135546-5f64-47b3-8123-034f355976b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8532aae-4105-4383-bcaa-f01efef32056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8532aae-4105-4383-bcaa-f01efef32056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3137860-9d87-4fcf-84ba-1c66213a0ca4', 'volume_name': 'volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc6191b-1e97-4aa7-bbec-3f6d7cfb828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc6191b-1e97-4aa7-bbec-3f6d7cfb828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70315f41-5c74-4fe9-8949-6f66fb8516a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:09 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Volume a3137860-9d87-4fcf-84ba-1c66213a0ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4', 'volume_size': 1} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1673853542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3137860-9d87-4fcf-84ba-1c66213a0ca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f319f02fa83442479dc5109a728e439a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:09Z,use_quota=True,user_id='fddd3c71b32343859ebfbd3ba50d3b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Creating volume a3137860-9d87-4fcf-84ba-1c66213a0ca4 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:09 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:09 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 1073741824 Apr 15 23:22:09 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:09 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.462s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:09 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Deleted volume successfully. Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0bd36bf8-bf80-427e-ac75-8d072ed21ad7 tempest-AbsoluteLimitsTests-1418554763 None] Lock "cinder-a9ecee1c-093f-4181-9cbd-d8cb2ca4d97e-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:09 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 1073741824" returned: 0 in 0.568s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:09 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 Apr 15 23:22:09 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:10 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70315f41-5c74-4fe9-8949-6f66fb8516a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4ef0fa-7163-482a-ab55-3087754e57d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:10 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Volume volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 (a3137860-9d87-4fcf-84ba-1c66213a0ca4): created successfully Apr 15 23:22:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4ef0fa-7163-482a-ab55-3087754e57d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:10 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Flow 'volume_create_manager' (5f147e1f-313b-411d-b929-c7bafe0d877b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:10 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e02fd2d7-9df7-4a4b-8a5a-721639298f68 tempest-VolumesTestJSON-1222184122 None] Created volume successfully. Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Flow 'volume_create_manager' (7113ea1c-93e6-4322-bf09-16d93fdbe18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae25bee-4244-4f00-9051-7846cdd68ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae25bee-4244-4f00-9051-7846cdd68ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1432391579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837ea603-0acf-4aa8-ae27-ba46da86b240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7277261fcdb94d1aa86c65d420ddbe3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:12Z,use_quota=True,user_id='4965abd65323427a9172e048338e0639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db34dd3-9739-4fd7-99a7-adcba2084917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db34dd3-9739-4fd7-99a7-adcba2084917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42466fdb-5f0c-4e7e-81b3-e6f63a6dc27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.image.glance [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Creating Keystone auth plugin from conf {{(pid=82388) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Flow 'volume_create_manager' (f828b045-142d-4fd0-85cf-fd47d028dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b026bd58-cde2-409f-8ea9-081fca916810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b026bd58-cde2-409f-8ea9-081fca916810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1883215777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b97884d-9a1f-4ce1-bf3f-61a73354aedf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f319f02fa83442479dc5109a728e439a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:12Z,use_quota=True,user_id='fddd3c71b32343859ebfbd3ba50d3b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ff6673-bdec-4671-be53-bf344f761608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ff6673-bdec-4671-be53-bf344f761608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9de2c10-637e-48c3-b1a0-ad0ca89b9f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9de2c10-637e-48c3-b1a0-ad0ca89b9f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b97884d-9a1f-4ce1-bf3f-61a73354aedf', 'volume_name': 'volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe2d5d2-e040-4c5d-b40d-b9ae5ae70ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe2d5d2-e040-4c5d-b40d-b9ae5ae70ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8f6013-fe6c-4540-9211-5ab2159ab2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Volume 8b97884d-9a1f-4ce1-bf3f-61a73354aedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf', 'volume_size': 1} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1883215777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b97884d-9a1f-4ce1-bf3f-61a73354aedf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f319f02fa83442479dc5109a728e439a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:12Z,use_quota=True,user_id='fddd3c71b32343859ebfbd3ba50d3b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Creating volume 8b97884d-9a1f-4ce1-bf3f-61a73354aedf {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:11 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:11 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf 1073741824 Apr 15 23:22:11 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42466fdb-5f0c-4e7e-81b3-e6f63a6dc27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '837ea603-0acf-4aa8-ae27-ba46da86b240', 'volume_name': 'volume-837ea603-0acf-4aa8-ae27-ba46da86b240', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12512e38-7b05-4e5e-9ec5-99982081f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12512e38-7b05-4e5e-9ec5-99982081f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5885ca8-5574-4036-8b16-4274619179ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:11 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Volume 837ea603-0acf-4aa8-ae27-ba46da86b240: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-837ea603-0acf-4aa8-ae27-ba46da86b240', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 23:22:11 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Trying to clone 837ea603-0acf-4aa8-ae27-ba46da86b240 from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]). {{(pid=82388) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 23:22:12 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Image download 20.69 MB at 20.69 MB/s Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc7fced-5d51-4ec8-811f-9a14798cec52]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:12 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD Apr 15 23:22:12 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:12 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf 1073741824" returned: 0 in 0.559s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:12 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf Apr 15 23:22:12 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Flow 'volume_create_manager' (ef75cf61-908c-456a-ae74-775cda0d3f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2ac543-52f6-4a89-9b40-36ed4741497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2ac543-52f6-4a89-9b40-36ed4741497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-130082910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3881cb-bc50-43d0-ae18-585b881bcd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c629b50624fc4f768fe0a48fc26b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:12Z,use_quota=True,user_id='cac9193da83f47418dcea5f6ae2637e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b11e25-9271-45a9-9a33-e0b8eed3b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b11e25-9271-45a9-9a33-e0b8eed3b84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae41a17-02ca-46b2-b9f3-54e6db7a6054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae41a17-02ca-46b2-b9f3-54e6db7a6054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3881cb-bc50-43d0-ae18-585b881bcd13', 'volume_name': 'volume-cd3881cb-bc50-43d0-ae18-585b881bcd13', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ee8204-3ffd-48bb-b656-84a3d75d38c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ee8204-3ffd-48bb-b656-84a3d75d38c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f0f0bc-7af1-4707-b14b-d59d5349ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:12 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Volume cd3881cb-bc50-43d0-ae18-585b881bcd13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3881cb-bc50-43d0-ae18-585b881bcd13', 'volume_size': 1} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:12 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD" returned: 0 in 0.552s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 is fetched for user 4965abd65323427a9172e048338e0639. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d1702-8fea-401a-884e-787f5b38dff8]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:12 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf" returned: 0 in 0.446s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.167s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-130082910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3881cb-bc50-43d0-ae18-585b881bcd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c629b50624fc4f768fe0a48fc26b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:12Z,use_quota=True,user_id='cac9193da83f47418dcea5f6ae2637e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Creating volume cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:12 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:12 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD Apr 15 23:22:12 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8f6013-fe6c-4540-9211-5ab2159ab2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:12 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 1073741824 Apr 15 23:22:12 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fabc8a-12b2-475b-a7e4-229a286dea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:12 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Volume volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf (8b97884d-9a1f-4ce1-bf3f-61a73354aedf): created successfully Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fabc8a-12b2-475b-a7e4-229a286dea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:12 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Flow 'volume_create_manager' (f828b045-142d-4fd0-85cf-fd47d028dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6c132d97-d1a0-4067-a7a0-5839d610b82d tempest-VolumesTestJSON-1222184122 None] Created volume successfully. Apr 15 23:22:13 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:13 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 1073741824" returned: 0 in 0.458s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:13 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 Apr 15 23:22:13 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:13 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13" returned: 0 in 0.412s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1432391579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837ea603-0acf-4aa8-ae27-ba46da86b240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7277261fcdb94d1aa86c65d420ddbe3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:12Z,use_quota=True,user_id='4965abd65323427a9172e048338e0639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Creating volume 837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:13 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f0f0bc-7af1-4707-b14b-d59d5349ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3881cb-bc50-43d0-ae18-585b881bcd13', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:13 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 1073741824 Apr 15 23:22:13 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa491f6-dbc5-45f7-b19f-3d50e2143171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:13 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Volume volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 (cd3881cb-bc50-43d0-ae18-585b881bcd13): created successfully Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa491f6-dbc5-45f7-b19f-3d50e2143171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Flow 'volume_create_manager' (ef75cf61-908c-456a-ae74-775cda0d3f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:13 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-235f50b0-41d8-4413-86c3-0dbd12ff5a21 tempest-VolumesDeleteCascade-660499724 None] Created volume successfully. Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Flow 'volume_create_manager' (a0d23185-ca36-4c43-aff0-89754a8fff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4a7c99-eea3-4394-ae0b-08138122f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4a7c99-eea3-4394-ae0b-08138122f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2121619344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402cb348-5128-40e0-843f-e7538bf9b837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f319f02fa83442479dc5109a728e439a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:14Z,use_quota=True,user_id='fddd3c71b32343859ebfbd3ba50d3b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a76415-2fc5-4868-a3f2-053bc437b096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a76415-2fc5-4868-a3f2-053bc437b096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb4521d-64af-4360-94c0-d9d223fd16d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb4521d-64af-4360-94c0-d9d223fd16d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402cb348-5128-40e0-843f-e7538bf9b837', 'volume_name': 'volume-402cb348-5128-40e0-843f-e7538bf9b837', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e1b2aa-147b-4ca4-9d8e-144a2474cb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e1b2aa-147b-4ca4-9d8e-144a2474cb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba963122-3743-4774-a6f3-749bc49e4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Volume 402cb348-5128-40e0-843f-e7538bf9b837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402cb348-5128-40e0-843f-e7538bf9b837', 'volume_size': 1} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:14 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 1073741824" returned: 0 in 0.522s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:14 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:14 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:14 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 0 in 0.402s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2121619344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402cb348-5128-40e0-843f-e7538bf9b837,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f319f02fa83442479dc5109a728e439a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:14Z,use_quota=True,user_id='fddd3c71b32343859ebfbd3ba50d3b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Creating volume 402cb348-5128-40e0-843f-e7538bf9b837 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:14 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:14 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 1073741824 Apr 15 23:22:14 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Attempting download of 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume 837ea603-0acf-4aa8-ae27-ba46da86b240. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b54016-56fd-4358-8b92-888e1af65da8]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_trzsl_f8 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:14 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_trzsl_f8 Apr 15 23:22:14 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:14 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:14 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:15 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 1073741824" returned: 0 in 0.507s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:15 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 Apr 15 23:22:15 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:15 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_trzsl_f8" returned: 0 in 0.516s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_trzsl_f8 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:15 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.441s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:15 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_trzsl_f8 Apr 15 23:22:15 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:15 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837" returned: 0 in 0.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.791s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba963122-3743-4774-a6f3-749bc49e4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402cb348-5128-40e0-843f-e7538bf9b837', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6b4536-202c-4600-beb7-c98eae5500a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Creating offline snapshot 11639ad5-f617-4606-8b7b-2b38eaa1d4a5 of volume cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:22:15 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Volume volume-402cb348-5128-40e0-843f-e7538bf9b837 (402cb348-5128-40e0-843f-e7538bf9b837): created successfully Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6b4536-202c-4600-beb7-c98eae5500a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Flow 'volume_create_manager' (a0d23185-ca36-4c43-aff0-89754a8fff8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aa0739-41da-4873-a570-095a3bf9c5a0]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:15 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4879e37d-734c-4000-8a0d-ec3b2543d604 tempest-VolumesTestJSON-1222184122 None] Created volume successfully. Apr 15 23:22:15 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 Apr 15 23:22:15 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:15 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_trzsl_f8" returned: 1 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_trzsl_f8' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef31607-34ea-4e9b-acb5-379a2dd07e62]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:15 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD Apr 15 23:22:15 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:16 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13" returned: 0 in 0.510s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:16 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 1G Apr 15 23:22:16 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:16 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] 7964c2ec-4e08-4c1d-802c-6b54500d24d6 was qcow2, converting to raw {{(pid=82388) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:16 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:16 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:16 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 1G" returned: 0 in 0.594s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:16 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 Apr 15 23:22:16 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "cinder-402cb348-5128-40e0-843f-e7538bf9b837-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-402cb348-5128-40e0-843f-e7538bf9b837-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "cinder-quobyte-402cb348-5128-40e0-843f-e7538bf9b837" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-quobyte-402cb348-5128-40e0-843f-e7538bf9b837" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[315bf2b3-ec01-4012-9ed0-8babe369876e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:16 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 Apr 15 23:22:16 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:17 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 0 in 0.968s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_fq7okbl8devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:22:17 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:17 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 1G Apr 15 23:22:17 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:17 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:17 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 is being set with open permissions: ugo+rw Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:17 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 Apr 15 23:22:17 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:17 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837" returned: 0 in 0.560s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:17 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837 Apr 15 23:22:17 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:17 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 1G" returned: 0 in 0.433s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:17 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5" returned: 0 in 0.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04aa100-f6e8-4a5d-9e71-93a336b9526a]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:17 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.info Apr 15 23:22:17 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:17 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:17 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:17 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-402cb348-5128-40e0-843f-e7538bf9b837" returned: 0 in 0.412s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-quobyte-402cb348-5128-40e0-843f-e7538bf9b837" released by "delete_volume" :: held 1.003s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Created reservations ['50511cac-fc41-4db6-b6ef-ec136bf4f94f', '3193c86f-6c5c-464f-a63b-caae97500724', 'a5645071-ab93-4c62-9c20-4ced7ded5d20', 'ce658055-875e-4caf-a566-ed78da65dd87'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:17 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:17 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Acquiring lock "cinder-8b97884d-9a1f-4ce1-bf3f-61a73354aedf-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Lock "cinder-8b97884d-9a1f-4ce1-bf3f-61a73354aedf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Acquiring lock "cinder-quobyte-8b97884d-9a1f-4ce1-bf3f-61a73354aedf" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Lock "cinder-quobyte-8b97884d-9a1f-4ce1-bf3f-61a73354aedf" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[715c0025-3835-4fe0-84b7-ff389987a301]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:18 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf Apr 15 23:22:18 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:18 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:18 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.info" returned: 0 in 0.514s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:18 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.info is being set with open permissions: ugo+rw Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:18 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.info Apr 15 23:22:18 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:18 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:18 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:18 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.457s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Deleted volume successfully. Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b7d27003-ce0e-483c-b867-3093b4bb35c5 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-402cb348-5128-40e0-843f-e7538bf9b837-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:18 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf" returned: 0 in 0.482s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:18 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf Apr 15 23:22:18 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:18 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 1 in 0.471s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Downloaded image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume 837ea603-0acf-4aa8-ae27-ba46da86b240 successfully. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 for user 4965abd65323427a9172e048338e0639 is deleted. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Marking volume 837ea603-0acf-4aa8-ae27-ba46da86b240 as bootable. {{(pid=82388) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Copying metadata from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 to 837ea603-0acf-4aa8-ae27-ba46da86b240. {{(pid=82388) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Creating volume glance metadata for volume 837ea603-0acf-4aa8-ae27-ba46da86b240 backed by image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82388) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 23:22:18 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.info" returned: 0 in 0.467s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-572da866-8c63-4b44-9c47-ba77209a55ea tempest-VolumesDeleteCascade-660499724 None] Create snapshot completed successfully Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5885ca8-5574-4036-8b16-4274619179ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837ea603-0acf-4aa8-ae27-ba46da86b240', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2bc915-2f1b-492f-8927-d43d9140f9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:18 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Volume volume-837ea603-0acf-4aa8-ae27-ba46da86b240 (837ea603-0acf-4aa8-ae27-ba46da86b240): created successfully Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2bc915-2f1b-492f-8927-d43d9140f9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Flow 'volume_create_manager' (7113ea1c-93e6-4322-bf09-16d93fdbe18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cc347eb1-f619-4ca4-a4fa-9e1077d27bc7 tempest-VolumesExtendTest-1808776833 None] Created volume successfully. Apr 15 23:22:18 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8b97884d-9a1f-4ce1-bf3f-61a73354aedf" returned: 0 in 0.429s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Lock "cinder-quobyte-8b97884d-9a1f-4ce1-bf3f-61a73354aedf" released by "delete_volume" :: held 0.936s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Created reservations ['1bbcd041-240b-438b-9dc5-b50b85db0f4c', '84914a1b-3f06-4ac5-bb5a-a7aafe6cfbc7', '5008b5d9-e29f-4e0a-a4cd-e516074c870c', 'd468e72b-0e99-441d-a5ad-0e8aa281574b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:19 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:19 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103b147-71d7-4bc3-950f-2fe4a7811765]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "cinder-a3137860-9d87-4fcf-84ba-1c66213a0ca4-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-a3137860-9d87-4fcf-84ba-1c66213a0ca4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "cinder-quobyte-a3137860-9d87-4fcf-84ba-1c66213a0ca4" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-quobyte-a3137860-9d87-4fcf-84ba-1c66213a0ca4" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[05153545-e998-4e93-9c18-59a6e8b28693]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:19 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:19 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:19 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 Apr 15 23:22:19 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:19 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Deleted volume successfully. Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8a82a48d-a0dc-4b08-9de5-7438fff2161c tempest-VolumesTestJSON-1222184122 None] Lock "cinder-8b97884d-9a1f-4ce1-bf3f-61a73354aedf-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:19 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 0 in 0.509s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:19 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:19 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:19 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4" returned: 0 in 0.476s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:19 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4 Apr 15 23:22:19 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:20 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 1 in 0.454s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 2G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 2G" returned: 0 in 0.050s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.049s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:20 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.976s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Creating offline snapshot 7dab59a1-01d7-4ecb-b747-a055171e5b76 of volume cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a3137860-9d87-4fcf-84ba-1c66213a0ca4" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c44c7-3c5b-42e9-a8d3-a5e66264b636]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-quobyte-a3137860-9d87-4fcf-84ba-1c66213a0ca4" released by "delete_volume" :: held 1.004s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3097a4b3-a706-43a7-bc7d-5de40d21a2ef tempest-VolumesExtendTest-1808776833 None] Extend volume completed successfully. Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Created reservations ['407c348f-d423-4fb6-ad8a-1e20428d7a9a', 'a9545d0d-88be-42b2-a0de-1cc1ccba1cf4', '0e66aedc-7f42-42c8-95e9-c6b39b2734f7', 'd8efcc8f-b86a-4394-9467-ec51a85426de'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:20 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 Apr 15 23:22:20 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:20 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:20 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:20 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5" returned: 0 in 0.457s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd3881cb-bc50-43d0-ae18-585b881bcd13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:20 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 1G Apr 15 23:22:20 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:20 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.396s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Deleted volume successfully. Apr 15 23:22:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-597aa093-9b7d-4542-91be-b573e5969511 tempest-VolumesTestJSON-1222184122 None] Lock "cinder-a3137860-9d87-4fcf-84ba-1c66213a0ca4-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:21 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 1G" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:21 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 Apr 15 23:22:21 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "cinder-837ea603-0acf-4aa8-ae27-ba46da86b240-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-837ea603-0acf-4aa8-ae27-ba46da86b240-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "cinder-quobyte-837ea603-0acf-4aa8-ae27-ba46da86b240" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-837ea603-0acf-4aa8-ae27-ba46da86b240" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6feb5e5-7921-46aa-8d4e-33ca26807417]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:21 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:21 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:21 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76" returned: 0 in 0.500s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:21 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 is being set with open permissions: ugo+rw Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:21 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 Apr 15 23:22:21 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:21 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 0 in 0.544s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:22 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:22 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:22 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-0da1a16c-f95b-41f5-88e2-14cec268b5f4 tempest-VolumesDeleteCascade-660499724 None] Create snapshot completed successfully Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-cd3881cb-bc50-43d0-ae18-585b881bcd13-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-cd3881cb-bc50-43d0-ae18-585b881bcd13-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Performing cascade delete. {{(pid=82388) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-11639ad5-f617-4606-8b7b-2b38eaa1d4a5-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-11639ad5-f617-4606-8b7b-2b38eaa1d4a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-11639ad5-f617-4606-8b7b-2b38eaa1d4a5" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-11639ad5-f617-4606-8b7b-2b38eaa1d4a5" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Deleting offline snapshot 11639ad5-f617-4606-8b7b-2b38eaa1d4a5 of volume cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] snapshot_file for this snap is: volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a976221-d86d-42ed-beb0-623284a13cf9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:22 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 Apr 15 23:22:22 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:22 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 1 in 0.555s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:22 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240 Apr 15 23:22:22 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:22 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5" returned: 0 in 0.546s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd3881cb-bc50-43d0-ae18-585b881bcd13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[47367425-5324-4a6d-a5ac-47b2d243aa8d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:22 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-837ea603-0acf-4aa8-ae27-ba46da86b240" returned: 0 in 0.431s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-837ea603-0acf-4aa8-ae27-ba46da86b240" released by "delete_volume" :: held 1.577s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:23 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 Apr 15 23:22:23 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Created reservations ['8d79e286-b663-4d8d-8d2c-ccdb128a4388', '9d77bc51-ca21-4697-af68-21ca383f16f9', '6aa89838-7a75-43f1-9a3d-3215b9586c43', '3253f2d1-4352-4616-be19-d40650580483'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:23 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:23 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:23 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13" returned: 0 in 0.604s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:23 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.465s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:23 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Deleted volume successfully. Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a007eb8-219b-4539-bb8d-4e52650fa16c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-106dff18-b783-4de6-bc2d-72b2b6d1b079 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-837ea603-0acf-4aa8-ae27-ba46da86b240-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:23 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 Apr 15 23:22:23 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Flow 'volume_create_manager' (b1e99ee9-7668-4735-9d2b-0f653e0834bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb36ccdc-df20-4d02-b65b-9a8adaf3ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb36ccdc-df20-4d02-b65b-9a8adaf3ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1930142644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cf515c-0fd1-4999-8f40-0e6b9da588e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7277261fcdb94d1aa86c65d420ddbe3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:24Z,use_quota=True,user_id='4965abd65323427a9172e048338e0639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dcece7-9b50-4e1e-a034-dc17c972f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dcece7-9b50-4e1e-a034-dc17c972f513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb626d-a13b-4acd-ac3e-36bf6a43dd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb626d-a13b-4acd-ac3e-36bf6a43dd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cf515c-0fd1-4999-8f40-0e6b9da588e4', 'volume_name': 'volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e8851f-340f-460c-b0bd-5d0be6399b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e8851f-340f-460c-b0bd-5d0be6399b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4bde69-9612-443e-baf7-47756597ffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:23 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Volume 19cf515c-0fd1-4999-8f40-0e6b9da588e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4', 'volume_size': 1} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1930142644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cf515c-0fd1-4999-8f40-0e6b9da588e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7277261fcdb94d1aa86c65d420ddbe3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:24Z,use_quota=True,user_id='4965abd65323427a9172e048338e0639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Creating volume 19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:23 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:23 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 1073741824 Apr 15 23:22:23 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:24 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76" returned: 0 in 0.570s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd3881cb-bc50-43d0-ae18-585b881bcd13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af83374-3576-422a-8ee9-52a0537d3e87]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:24 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 Apr 15 23:22:24 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:24 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 1073741824" returned: 0 in 0.572s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:24 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 Apr 15 23:22:24 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:24 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5" returned: 0 in 0.562s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd3881cb-bc50-43d0-ae18-585b881bcd13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[898a04f1-d12b-43dd-a4ae-29bc5cfcfbdf]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:24 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 Apr 15 23:22:24 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:24 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4" returned: 0 in 0.479s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4bde69-9612-443e-baf7-47756597ffa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e125d93e-9119-490c-8921-d5cf32bc22a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:24 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Volume volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 (19cf515c-0fd1-4999-8f40-0e6b9da588e4): created successfully Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e125d93e-9119-490c-8921-d5cf32bc22a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:24 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Flow 'volume_create_manager' (b1e99ee9-7668-4735-9d2b-0f653e0834bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:24 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f002f703-e743-4040-bf6d-d87908bcfddc tempest-VolumesExtendTest-1808776833 None] Created volume successfully. Apr 15 23:22:25 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13" returned: 0 in 0.495s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:25 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 Apr 15 23:22:25 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:25 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5" returned: 0 in 0.468s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:25 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5 Apr 15 23:22:25 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Creating offline snapshot 4157430f-b201-4d8b-b7dc-82111b98beed of volume 19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[893d40b0-0e88-42d1-bbcb-87c764241839]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:26 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.11639ad5-f617-4606-8b7b-2b38eaa1d4a5" returned: 0 in 0.450s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:26 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 -F qcow2 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:26 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:26 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 -F qcow2 Apr 15 23:22:26 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:26 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4" returned: 0 in 0.537s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:26 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed 1G Apr 15 23:22:26 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:26 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 -F qcow2" returned: 0 in 0.517s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-11639ad5-f617-4606-8b7b-2b38eaa1d4a5" released by "_delete_snapshot" :: held 4.318s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" released by "delete_snapshot" :: held 4.328s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Created reservations ['b34ea327-e42a-4c47-8b6b-ea4147d99686', 'fa7d519a-4ca8-473f-b05e-4925334bbb70', '2646dd18-5bd0-46c3-aee5-ed82d6c59d14', '3bf057ce-4ee1-4139-99d9-8b904947490f'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Delete snapshot completed successfully. Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-11639ad5-f617-4606-8b7b-2b38eaa1d4a5-delete_snapshot" released by "delete_snapshot" :: held 4.429s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-7dab59a1-01d7-4ecb-b747-a055171e5b76-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-7dab59a1-01d7-4ecb-b747-a055171e5b76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-7dab59a1-01d7-4ecb-b747-a055171e5b76" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-7dab59a1-01d7-4ecb-b747-a055171e5b76" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Deleting offline snapshot 7dab59a1-01d7-4ecb-b747-a055171e5b76 of volume cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] snapshot_file for this snap is: volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2e4355-ad8a-425d-b336-21c92cee0101]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:26 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 Apr 15 23:22:26 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:27 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed 1G" returned: 0 in 0.608s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:27 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed Apr 15 23:22:27 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:27 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76" returned: 0 in 0.520s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd3881cb-bc50-43d0-ae18-585b881bcd13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f2055d-12dc-4d72-865a-d41a073160cd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:27 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 Apr 15 23:22:27 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:27 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed" returned: 0 in 0.508s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:27 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed is being set with open permissions: ugo+rw Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:27 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed Apr 15 23:22:27 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:27 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13" returned: 0 in 0.511s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:27 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 Apr 15 23:22:27 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:28 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:28 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.info Apr 15 23:22:28 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:28 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:28 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76 Apr 15 23:22:28 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:28 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.info" returned: 0 in 0.439s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:28 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.info is being set with open permissions: ugo+rw Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:28 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.info Apr 15 23:22:28 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:28 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13.7dab59a1-01d7-4ecb-b747-a055171e5b76" returned: 0 in 0.471s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-7dab59a1-01d7-4ecb-b747-a055171e5b76" released by "_delete_snapshot" :: held 2.041s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" released by "delete_snapshot" :: held 2.052s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Created reservations ['e6782da3-5365-4f53-ac01-91a145d5a8c1', 'fe14b458-ad7f-4a0b-9e0e-9d837c71c8a5', '781a91f8-e835-4b4c-b4cc-277cf323a17d', 'fd409b28-e307-4e24-af68-05739e6e7ccf'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Flow 'volume_create_manager' (fb40cda2-4879-4b68-a340-d4ec35eba557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e908d-1037-4b42-8550-cdcced5eec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e908d-1037-4b42-8550-cdcced5eec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-713388952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd670664-422c-4ecc-b3be-2ff180362167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbe507e016b44a1be8f07e4099310d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:29Z,use_quota=True,user_id='af1b526cc6624da6baffe1cde72773bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cf3e68-70a9-4a56-9213-b3b2f7c32efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cf3e68-70a9-4a56-9213-b3b2f7c32efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7427b8-c6f6-4dc0-8df3-807e794b0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7427b8-c6f6-4dc0-8df3-807e794b0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd670664-422c-4ecc-b3be-2ff180362167', 'volume_name': 'volume-dd670664-422c-4ecc-b3be-2ff180362167', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dffc71-8ff0-4458-b0fb-42aad8da765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dffc71-8ff0-4458-b0fb-42aad8da765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b63c90-d770-4d95-bb13-5bd70cbc4d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Volume dd670664-422c-4ecc-b3be-2ff180362167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd670664-422c-4ecc-b3be-2ff180362167', 'volume_size': 1} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Delete snapshot completed successfully. Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-7dab59a1-01d7-4ecb-b747-a055171e5b76-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Snapshots deleted, issuing volume delete {{(pid=82388) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c03c78e-bcd5-4288-a4e6-ccc322f214b7]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:29 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 Apr 15 23:22:29 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:29 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.info" returned: 0 in 0.487s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.148s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.235s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-713388952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd670664-422c-4ecc-b3be-2ff180362167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbe507e016b44a1be8f07e4099310d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:29Z,use_quota=True,user_id='af1b526cc6624da6baffe1cde72773bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Creating volume dd670664-422c-4ecc-b3be-2ff180362167 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:29 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:29 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 1073741824 Apr 15 23:22:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-51f1f43a-3344-4e84-965d-493cfe94cdec tempest-VolumesExtendTest-1808776833 None] Create snapshot completed successfully Apr 15 23:22:29 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:29 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13" returned: 0 in 0.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:29 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13 Apr 15 23:22:29 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:29 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 1073741824" returned: 0 in 0.455s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:29 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 Apr 15 23:22:29 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:29 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-cd3881cb-bc50-43d0-ae18-585b881bcd13" returned: 0 in 0.429s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-cd3881cb-bc50-43d0-ae18-585b881bcd13" released by "delete_volume" :: held 0.928s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Created reservations ['406bf7dd-53d6-41ef-9ac2-e89db547a756', 'eec9eaed-1c47-4025-ba3e-1a84c1589241', '36accb47-41a2-4185-99f0-4caa023b2f5b', '8fc969a6-eb02-4622-8a38-da859c41cc56'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:29 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:29 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:30 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167" returned: 0 in 0.413s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b63c90-d770-4d95-bb13-5bd70cbc4d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd670664-422c-4ecc-b3be-2ff180362167', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37625ab-615d-4bec-90de-e7f65692626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:30 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Volume volume-dd670664-422c-4ecc-b3be-2ff180362167 (dd670664-422c-4ecc-b3be-2ff180362167): created successfully Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37625ab-615d-4bec-90de-e7f65692626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Flow 'volume_create_manager' (fb40cda2-4879-4b68-a340-d4ec35eba557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:30 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fb64d00a-eb84-48ee-a75a-e41e87250dc5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Created volume successfully. Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0967f9-29c5-49e3-a714-92990e53a86c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:30 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 Apr 15 23:22:30 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:30 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:30 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Deleted volume successfully. Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-468f2aae-0b48-4213-b637-276085da4227 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-cd3881cb-bc50-43d0-ae18-585b881bcd13-delete_volume" released by "delete_volume" :: held 8.204s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:30 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4" returned: 0 in 0.493s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed 2G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed 2G" returned: 0 in 0.071s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.583s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:30 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6a1ba55c-9e1f-46a3-ad22-9a7f30884f9e tempest-VolumesExtendTest-1808776833 None] Extend volume completed successfully. Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Acquiring lock "cinder-dd670664-422c-4ecc-b3be-2ff180362167-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "cinder-dd670664-422c-4ecc-b3be-2ff180362167-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Acquiring lock "cinder-quobyte-dd670664-422c-4ecc-b3be-2ff180362167" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "cinder-quobyte-dd670664-422c-4ecc-b3be-2ff180362167" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa053d7-66c1-44e4-bb8c-ec63c575f916]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:31 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 Apr 15 23:22:31 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Flow 'volume_create_manager' (49aadf88-d0a7-42e2-b608-3a9ba679e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413a6e17-051a-4113-b0c4-b82993ad820d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413a6e17-051a-4113-b0c4-b82993ad820d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1106954980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03387266-458c-4378-8d38-368e342de963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c629b50624fc4f768fe0a48fc26b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:31Z,use_quota=True,user_id='cac9193da83f47418dcea5f6ae2637e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd52994-70ce-4d06-9bdf-35dd1eefe88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd52994-70ce-4d06-9bdf-35dd1eefe88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7004d3-a26a-4e8b-bf1a-c62dac6f7299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7004d3-a26a-4e8b-bf1a-c62dac6f7299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03387266-458c-4378-8d38-368e342de963', 'volume_name': 'volume-03387266-458c-4378-8d38-368e342de963', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d200c1a8-30a9-498a-b19c-f9b7e85c28d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d200c1a8-30a9-498a-b19c-f9b7e85c28d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6fb3cc-93a4-49e4-b5b4-e907e2728dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:31 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Volume 03387266-458c-4378-8d38-368e342de963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03387266-458c-4378-8d38-368e342de963', 'volume_size': 1} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1106954980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03387266-458c-4378-8d38-368e342de963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c629b50624fc4f768fe0a48fc26b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:31Z,use_quota=True,user_id='cac9193da83f47418dcea5f6ae2637e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Creating volume 03387266-458c-4378-8d38-368e342de963 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:31 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:31 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 1073741824 Apr 15 23:22:31 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "cinder-4157430f-b201-4d8b-b7dc-82111b98beed-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-4157430f-b201-4d8b-b7dc-82111b98beed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "cinder-quobyte-19cf515c-0fd1-4999-8f40-0e6b9da588e4" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-19cf515c-0fd1-4999-8f40-0e6b9da588e4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "cinder-quobyte-4157430f-b201-4d8b-b7dc-82111b98beed" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-4157430f-b201-4d8b-b7dc-82111b98beed" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Deleting offline snapshot 4157430f-b201-4d8b-b7dc-82111b98beed of volume 19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] snapshot_file for this snap is: volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb623b-e7b8-4c21-8d84-e750f57580a8]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:31 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed Apr 15 23:22:31 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:31 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:31 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167 Apr 15 23:22:31 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:31 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 1073741824" returned: 0 in 0.544s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:31 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 Apr 15 23:22:31 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:31 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed" returned: 0 in 0.476s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1b4136-9d83-4f3f-8528-e6c08b8f0539]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:31 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 Apr 15 23:22:31 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:32 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dd670664-422c-4ecc-b3be-2ff180362167" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "cinder-quobyte-dd670664-422c-4ecc-b3be-2ff180362167" released by "delete_volume" :: held 0.955s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Created reservations ['59b76975-2d1a-4484-b50b-cb389f88309b', 'a2242702-4fcc-43dc-84c5-16d8d67d122c', 'bc7ef339-c91a-4e4b-8b80-6cf33c1cc613', '929c2b92-4b5e-4ca6-824d-a763d700221f'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:32 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:32 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:32 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963" returned: 0 in 0.461s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6fb3cc-93a4-49e4-b5b4-e907e2728dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03387266-458c-4378-8d38-368e342de963', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb91df0-0ece-4118-a324-24699aec9e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:32 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Volume volume-03387266-458c-4378-8d38-368e342de963 (03387266-458c-4378-8d38-368e342de963): created successfully Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb91df0-0ece-4118-a324-24699aec9e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Flow 'volume_create_manager' (49aadf88-d0a7-42e2-b608-3a9ba679e963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:32 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8b7d274b-1fb1-49b4-90de-1d4d5d264002 tempest-VolumesDeleteCascade-660499724 None] Created volume successfully. Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Flow 'volume_create_manager' (6260ba69-1d8e-42f3-a0ad-ae76b2286183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1570679-67ed-4ba1-8b9b-490e3e64886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:32 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4" returned: 0 in 0.561s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1570679-67ed-4ba1-8b9b-490e3e64886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-714022885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef5fd6c-4d34-416a-90fd-cc60ab138e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbe507e016b44a1be8f07e4099310d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:32Z,use_quota=True,user_id='af1b526cc6624da6baffe1cde72773bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:32 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80eb803-1ec5-437a-837e-6d08d84b5979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:32 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80eb803-1ec5-437a-837e-6d08d84b5979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41589d17-591d-4d62-aebd-394c3eddb231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41589d17-591d-4d62-aebd-394c3eddb231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef5fd6c-4d34-416a-90fd-cc60ab138e9d', 'volume_name': 'volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da301068-d5ac-4ae6-8c5a-ab071289b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da301068-d5ac-4ae6-8c5a-ab071289b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ae5bdd-bc3b-43be-b09b-8960ccbfec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:32 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Volume 6ef5fd6c-4d34-416a-90fd-cc60ab138e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d', 'volume_size': 1} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-714022885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef5fd6c-4d34-416a-90fd-cc60ab138e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbe507e016b44a1be8f07e4099310d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:32Z,use_quota=True,user_id='af1b526cc6624da6baffe1cde72773bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Creating volume 6ef5fd6c-4d34-416a-90fd-cc60ab138e9d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:32 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:32 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d 1073741824 Apr 15 23:22:32 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:32 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.486s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:32 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Deleted volume successfully. Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-62e00e5a-e3f3-4126-a6ac-a5af8f67bb5a tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "cinder-dd670664-422c-4ecc-b3be-2ff180362167-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:32 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed" returned: 0 in 0.479s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:32 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed Apr 15 23:22:32 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:33 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d 1073741824" returned: 0 in 0.493s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:33 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d Apr 15 23:22:33 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:33 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4.4157430f-b201-4d8b-b7dc-82111b98beed" returned: 0 in 0.452s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-4157430f-b201-4d8b-b7dc-82111b98beed" released by "_delete_snapshot" :: held 2.041s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-19cf515c-0fd1-4999-8f40-0e6b9da588e4" released by "delete_snapshot" :: held 2.054s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:33 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.043s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ae5bdd-bc3b-43be-b09b-8960ccbfec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c1b76e-0468-4b61-9ab7-ef56d1ed8326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Creating offline snapshot 20a3b66c-42a6-4a37-be17-7dba9cffd4fc of volume 03387266-458c-4378-8d38-368e342de963 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:22:33 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Volume volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d (6ef5fd6c-4d34-416a-90fd-cc60ab138e9d): created successfully Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c1b76e-0468-4b61-9ab7-ef56d1ed8326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Flow 'volume_create_manager' (6260ba69-1d8e-42f3-a0ad-ae76b2286183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0c0470-3628-4913-bbf4-8425051488d0]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a4fcb166-4525-4da3-9a00-bf95f52c33d5 tempest-VolumeQuotasAdminTestJSON-348711706 None] Created volume successfully. Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Created reservations ['9b13c250-b363-46b1-b1fb-454539047e96', '09cd55c5-2a7d-471c-af3a-959fc7cf7752', 'db2b27c2-af4e-474b-9d73-5464498bbd13', 'c152dfca-64b9-4d8a-a690-ad9cfb44f638'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Delete snapshot completed successfully. Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-326a1615-64f2-4096-b9f6-b7e66a13a666 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-4157430f-b201-4d8b-b7dc-82111b98beed-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:33 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 Apr 15 23:22:33 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:33 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963" returned: 0 in 0.467s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:34 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc 1G Apr 15 23:22:34 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:34 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc 1G" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03387266-458c-4378-8d38-368e342de963 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:34 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03387266-458c-4378-8d38-368e342de963 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc Apr 15 23:22:34 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "cinder-19cf515c-0fd1-4999-8f40-0e6b9da588e4-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-19cf515c-0fd1-4999-8f40-0e6b9da588e4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "cinder-quobyte-19cf515c-0fd1-4999-8f40-0e6b9da588e4" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-19cf515c-0fd1-4999-8f40-0e6b9da588e4" acquired by "delete_volume" :: waited 0.022s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[2180bd43-53c7-4c26-9398-0ef8fafe791f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:34 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 Apr 15 23:22:34 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:34 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03387266-458c-4378-8d38-368e342de963 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc" returned: 0 in 0.487s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:34 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc is being set with open permissions: ugo+rw Apr 15 23:22:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:34 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8431aff5-23e6-4e13-94ce-8c66e394db83 tempest-VolumeQuotasAdminTestJSON-222400497 None] Transfer volume completed successfully. Apr 15 23:22:34 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc Apr 15 23:22:34 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:35 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4" returned: 0 in 0.488s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:35 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4 Apr 15 23:22:35 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:35 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc" returned: 0 in 0.403s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:35 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.info Apr 15 23:22:35 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:35 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19cf515c-0fd1-4999-8f40-0e6b9da588e4" returned: 0 in 0.404s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-quobyte-19cf515c-0fd1-4999-8f40-0e6b9da588e4" released by "delete_volume" :: held 0.924s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Created reservations ['a2570411-af68-42aa-a00c-6842a6f15142', 'fb1ef6ae-0b3e-44fe-ba40-7e6876b1a02a', '215679bb-ecbc-4424-ab1c-72f78a26856d', '73dbcefa-2676-4eb8-aa27-822d01c3e3d4'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:35 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:35 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Acquiring lock "cinder-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Lock "cinder-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Acquiring lock "cinder-quobyte-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Lock "cinder-quobyte-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2217a0-89d0-4d5b-8d01-e77762506421]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:35 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.info" returned: 0 in 0.499s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:35 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.info is being set with open permissions: ugo+rw Apr 15 23:22:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:35 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.info Apr 15 23:22:35 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:35 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d Apr 15 23:22:35 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:36 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Deleted volume successfully. Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45929afe-00ed-47cc-be25-d85023ec2769 tempest-VolumesExtendTest-1808776833 None] Lock "cinder-19cf515c-0fd1-4999-8f40-0e6b9da588e4-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:36 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d" returned: 0 in 0.498s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:36 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d Apr 15 23:22:36 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:36 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.info" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.908s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-36477cc3-fe3f-4b01-9b5d-f87ef9ca6a37 tempest-VolumesDeleteCascade-660499724 None] Create snapshot completed successfully Apr 15 23:22:36 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d" returned: 0 in 0.404s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Lock "cinder-quobyte-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d" released by "delete_volume" :: held 0.929s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Created reservations ['caef6fff-d109-4949-adcc-acefe88f781a', '34227560-6c37-48d4-aa2d-1e43b6245d23', '084ad02f-86dd-4a91-a47a-2e1d1e4af891', 'bc3b3abd-683f-4b2c-a9de-1f8df3ce7319'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:36 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:36 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Flow 'volume_create_manager' (6173db2c-edd4-4cb2-bef1-4bab51e126b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31ddb60-27ea-46cc-a129-b20165cd15ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31ddb60-27ea-46cc-a129-b20165cd15ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1180489486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8b6fbd-68b1-44e6-ac6a-21b05742100e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c629b50624fc4f768fe0a48fc26b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20a3b66c-42a6-4a37-be17-7dba9cffd4fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:37Z,use_quota=True,user_id='cac9193da83f47418dcea5f6ae2637e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787ac609-c0ab-4e5e-bb1c-56b4291604b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787ac609-c0ab-4e5e-bb1c-56b4291604b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7445b03d-0330-41ec-8383-507de5904ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7445b03d-0330-41ec-8383-507de5904ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e8b6fbd-68b1-44e6-ac6a-21b05742100e', 'volume_name': 'volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e', 'volume_size': 1, 'snapshot_id': '20a3b66c-42a6-4a37-be17-7dba9cffd4fc'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbeac834-8d21-4ad7-b380-930047870b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbeac834-8d21-4ad7-b380-930047870b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a98126-5afb-49ca-a768-22fe3e8cffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:36 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Volume 0e8b6fbd-68b1-44e6-ac6a-21b05742100e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e', 'volume_size': 1, 'snapshot_id': '20a3b66c-42a6-4a37-be17-7dba9cffd4fc'} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-20a3b66c-42a6-4a37-be17-7dba9cffd4fc-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-20a3b66c-42a6-4a37-be17-7dba9cffd4fc-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Creating volume 0e8b6fbd-68b1-44e6-ac6a-21b05742100e from snapshot 20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] snapshot: 20a3b66c-42a6-4a37-be17-7dba9cffd4fc, volume: 0e8b6fbd-68b1-44e6-ac6a-21b05742100e, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c914f48-b53d-43dd-b6d5-475fe500782b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:37 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc Apr 15 23:22:37 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:37 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.468s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:37 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Deleted volume successfully. Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ecade1f7-1005-4b4c-bd94-41a40ef4f0f6 tempest-VolumeQuotasAdminTestJSON-1180265713 None] Lock "cinder-6ef5fd6c-4d34-416a-90fd-cc60ab138e9d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:37 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc" returned: 0 in 0.583s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03387266-458c-4378-8d38-368e342de963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf54784-86d8-4da3-9523-aec6d97b1bee]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:37 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 Apr 15 23:22:37 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:38 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963" returned: 0 in 0.530s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:38 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:22:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:38 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e Apr 15 23:22:38 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:40 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" returned: 0 in 2.260s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:40 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19e8377-087b-4b21-9f60-e9032f8f509d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:40 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 Apr 15 23:22:40 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:41 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963" returned: 0 in 0.762s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:22:41 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Converted 1024.00 MB image at 452.93 MB/s Apr 15 23:22:41 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e is being set with open permissions: ugo+rw Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:41 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e Apr 15 23:22:41 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:41 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" returned: 0 in 0.567s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" released by "_copy_volume_from_snapshot" :: held 4.767s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-20a3b66c-42a6-4a37-be17-7dba9cffd4fc-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" released by "_create_volume_from_snapshot" :: held 4.791s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.803s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a98126-5afb-49ca-a768-22fe3e8cffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e', 'volume_size': 1, 'snapshot_id': '20a3b66c-42a6-4a37-be17-7dba9cffd4fc'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16600a8a-ef7e-4116-985b-4b563335209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=176,cinder:UPDATE=249,cinder:DELETE=26,cinder:INSERT=74 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:22:41 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Volume volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e (0e8b6fbd-68b1-44e6-ac6a-21b05742100e): created successfully Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16600a8a-ef7e-4116-985b-4b563335209c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Flow 'volume_create_manager' (6173db2c-edd4-4cb2-bef1-4bab51e126b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:41 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-971765d3-ea05-4d3d-b99c-fcfff60139f4 tempest-VolumesDeleteCascade-660499724 None] Created volume successfully. Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-03387266-458c-4378-8d38-368e342de963-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-03387266-458c-4378-8d38-368e342de963-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Performing cascade delete. {{(pid=82388) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-20a3b66c-42a6-4a37-be17-7dba9cffd4fc-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-20a3b66c-42a6-4a37-be17-7dba9cffd4fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-03387266-458c-4378-8d38-368e342de963" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-03387266-458c-4378-8d38-368e342de963" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-20a3b66c-42a6-4a37-be17-7dba9cffd4fc" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-20a3b66c-42a6-4a37-be17-7dba9cffd4fc" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Deleting offline snapshot 20a3b66c-42a6-4a37-be17-7dba9cffd4fc of volume 03387266-458c-4378-8d38-368e342de963 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] snapshot_file for this snap is: volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[104718b1-409d-4dad-a0f0-9fae8b2393bf]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:42 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc Apr 15 23:22:42 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Flow 'volume_create_manager' (fb99d8e6-75d5-4f82-8d1f-cc409ef5a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af162a11-c7df-4f6b-9c30-c5947036c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af162a11-c7df-4f6b-9c30-c5947036c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-519184712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448baba1-0e14-4ad6-8bbe-3fa3f0632edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e78fc38e964839b36e8540175c4657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:43Z,use_quota=True,user_id='bd0a02ece37248c6acbf763c4cc5c2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af865b16-d13a-4e24-9dfa-c489f2d23948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af865b16-d13a-4e24-9dfa-c489f2d23948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b95cdf-9514-48a6-b129-9d938b116538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b95cdf-9514-48a6-b129-9d938b116538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448baba1-0e14-4ad6-8bbe-3fa3f0632edb', 'volume_name': 'volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bf9517-3bca-4a59-a20f-54c8264f2709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bf9517-3bca-4a59-a20f-54c8264f2709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd726453-ed4e-4198-8b86-21f452c2c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:43 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Volume 448baba1-0e14-4ad6-8bbe-3fa3f0632edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb', 'volume_size': 1} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:43 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-519184712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448baba1-0e14-4ad6-8bbe-3fa3f0632edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e78fc38e964839b36e8540175c4657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:43Z,use_quota=True,user_id='bd0a02ece37248c6acbf763c4cc5c2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Creating volume 448baba1-0e14-4ad6-8bbe-3fa3f0632edb {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:43 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc" returned: 0 in 0.583s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03387266-458c-4378-8d38-368e342de963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:43 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb 1073741824 Apr 15 23:22:43 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daf7a3f-8dc5-4cd9-af50-f6d582a2fd02]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:43 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 Apr 15 23:22:43 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:43 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb 1073741824" returned: 0 in 0.543s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:43 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963" returned: 0 in 0.521s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:43 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc Apr 15 23:22:43 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:43 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb Apr 15 23:22:43 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:44 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc" returned: 0 in 0.569s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:44 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc Apr 15 23:22:44 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:44 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb" returned: 0 in 0.573s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd726453-ed4e-4198-8b86-21f452c2c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ced3ca-9259-4729-85a3-3d1561a6295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:44 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Volume volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb (448baba1-0e14-4ad6-8bbe-3fa3f0632edb): created successfully Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ced3ca-9259-4729-85a3-3d1561a6295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Flow 'volume_create_manager' (fb99d8e6-75d5-4f82-8d1f-cc409ef5a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a7fd6431-3ad0-4c12-bec8-0f12707a1d04 tempest-VolumesServicesTestJSON-317776801 None] Created volume successfully. Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (ca1dd5cf-5ab6-42b7-82eb-5efd9d052499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7dcb44-58a1-4443-a473-37d83d94e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7dcb44-58a1-4443-a473-37d83d94e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-628373832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d840118-1d82-4f83-9cd8-b360542f2c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:44Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0df509-f8ee-4a54-8b31-9d512a7e6835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0df509-f8ee-4a54-8b31-9d512a7e6835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f1f939-0156-4e8d-adc3-7263b685ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f1f939-0156-4e8d-adc3-7263b685ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d840118-1d82-4f83-9cd8-b360542f2c6d', 'volume_name': 'volume-6d840118-1d82-4f83-9cd8-b360542f2c6d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7249d6e7-232e-4565-a6d8-06838a98a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7249d6e7-232e-4565-a6d8-06838a98a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f59283d-4c00-4706-aa59-34bd098caa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:44 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Volume 6d840118-1d82-4f83-9cd8-b360542f2c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d840118-1d82-4f83-9cd8-b360542f2c6d', 'volume_size': 1} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-628373832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d840118-1d82-4f83-9cd8-b360542f2c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:44Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Creating volume 6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:44 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:44 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d 1073741824 Apr 15 23:22:44 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:44 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963.20a3b66c-42a6-4a37-be17-7dba9cffd4fc" returned: 0 in 0.427s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-20a3b66c-42a6-4a37-be17-7dba9cffd4fc" released by "_delete_snapshot" :: held 2.158s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-03387266-458c-4378-8d38-368e342de963" released by "delete_snapshot" :: held 2.170s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Created reservations ['4c4a481f-d015-404a-a451-33fb67397ea7', '99ee683e-135e-400c-8060-d8386e86f9be', 'fbf89f0d-2181-4de4-9e3b-64eb9391fba2', '9f4042c5-5a40-4b0d-aedf-af60137b1bff'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Delete snapshot completed successfully. Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-20a3b66c-42a6-4a37-be17-7dba9cffd4fc-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Snapshots deleted, issuing volume delete {{(pid=82388) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-03387266-458c-4378-8d38-368e342de963" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-03387266-458c-4378-8d38-368e342de963" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb0891-e010-4384-8885-63076f95a74b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:44 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 Apr 15 23:22:44 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:44 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d 1073741824" returned: 0 in 0.465s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:45 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d Apr 15 23:22:45 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Acquiring lock "cinder-448baba1-0e14-4ad6-8bbe-3fa3f0632edb-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Lock "cinder-448baba1-0e14-4ad6-8bbe-3fa3f0632edb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:45 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963" returned: 0 in 0.539s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Acquiring lock "cinder-quobyte-448baba1-0e14-4ad6-8bbe-3fa3f0632edb" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:45 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963 Apr 15 23:22:45 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Lock "cinder-quobyte-448baba1-0e14-4ad6-8bbe-3fa3f0632edb" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f567eb-0bbc-4b8b-bcbb-54d3705b972f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:45 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb Apr 15 23:22:45 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:45 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f59283d-4c00-4706-aa59-34bd098caa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d840118-1d82-4f83-9cd8-b360542f2c6d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a83ca-fc98-45c6-9e13-ab21cc978a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:45 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Volume volume-6d840118-1d82-4f83-9cd8-b360542f2c6d (6d840118-1d82-4f83-9cd8-b360542f2c6d): created successfully Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a83ca-fc98-45c6-9e13-ab21cc978a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (ca1dd5cf-5ab6-42b7-82eb-5efd9d052499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:45 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a0e72417-caef-448b-9f6a-d6da63ba5ef3 tempest-VolumesSnapshotTestJSON-665282475 None] Created volume successfully. Apr 15 23:22:45 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-03387266-458c-4378-8d38-368e342de963" returned: 0 in 0.436s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-03387266-458c-4378-8d38-368e342de963" released by "delete_volume" :: held 1.002s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Created reservations ['ca09efdd-f466-45b0-b867-aaa5622bbbd4', '7ac9a707-e8b0-4feb-a270-27b729bdec5c', '0e4b3350-d399-4556-9c86-d58c993affc5', '891b4d8d-475e-4b4a-a5bf-1f6edf43f2c3'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:45 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb" returned: 0 in 0.500s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:45 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:45 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:45 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb Apr 15 23:22:45 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:46 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-448baba1-0e14-4ad6-8bbe-3fa3f0632edb" returned: 0 in 0.387s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Lock "cinder-quobyte-448baba1-0e14-4ad6-8bbe-3fa3f0632edb" released by "delete_volume" :: held 0.909s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:46 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:46 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Deleted volume successfully. Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Created reservations ['afd34818-cabd-44d0-ad61-5d3576f2a520', 'fabd3bc6-d896-4487-9175-b69bb95fe4c1', '37e72fb5-a7c6-4dbd-b412-ebc45ebfc602', '3b4c669d-779a-4c3d-b694-40371bf295d3'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-4e652b69-be71-45f8-a3eb-e844429cb1c3 tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-03387266-458c-4378-8d38-368e342de963-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:46 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:46 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:46 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.452s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:46 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Deleted volume successfully. Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-0e8b6fbd-68b1-44e6-ac6a-21b05742100e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e399405c-636f-4178-a077-8de40361623a tempest-VolumesServicesTestJSON-317776801 None] Lock "cinder-448baba1-0e14-4ad6-8bbe-3fa3f0632edb-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-0e8b6fbd-68b1-44e6-ac6a-21b05742100e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "cinder-quobyte-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfe31d7-7315-40ef-941b-ac690b0813b0]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Creating offline snapshot b4d89274-984a-4e44-a63c-534dca7709fd of volume 6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab3a682-6284-47f5-a700-d5ce1e64a129]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:46 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e Apr 15 23:22:46 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:46 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d Apr 15 23:22:46 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:47 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" returned: 0 in 0.589s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:47 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d" returned: 0 in 0.538s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:47 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e Apr 15 23:22:47 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:47 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd 1G Apr 15 23:22:47 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:47 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" returned: 0 in 0.503s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-quobyte-0e8b6fbd-68b1-44e6-ac6a-21b05742100e" released by "delete_volume" :: held 1.121s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Created reservations ['68e49c23-804d-442a-ba6d-2f3188c92972', '94060e78-5dfc-4d8f-b8e9-8184546513d0', '389456b1-d6ce-4ea1-a31e-6e379bc66d37', 'bf25af8e-ff74-4491-ab13-384bc4a2c9c1'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:47 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd 1G" returned: 0 in 0.583s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d840118-1d82-4f83-9cd8-b360542f2c6d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:48 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d840118-1d82-4f83-9cd8-b360542f2c6d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd Apr 15 23:22:48 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:48 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:22:48 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:48 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.452s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:48 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:22:48 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Deleted volume successfully. Apr 15 23:22:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb1dad4c-0fea-451f-a686-bfc3786b60ef tempest-VolumesDeleteCascade-660499724 None] Lock "cinder-0e8b6fbd-68b1-44e6-ac6a-21b05742100e-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:48 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d840118-1d82-4f83-9cd8-b360542f2c6d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd" returned: 0 in 0.512s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:48 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd is being set with open permissions: ugo+rw Apr 15 23:22:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:48 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd Apr 15 23:22:48 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:48 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:48 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.info Apr 15 23:22:48 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:49 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.info" returned: 0 in 0.437s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:49 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.info is being set with open permissions: ugo+rw Apr 15 23:22:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:49 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.info Apr 15 23:22:49 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:49 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.info" returned: 0 in 0.554s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.136s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:50 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4916d038-bac0-49d6-bde3-5ddc1d11a583 tempest-VolumesSnapshotTestJSON-665282475 None] Create snapshot completed successfully Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-b4d89274-984a-4e44-a63c-534dca7709fd-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-b4d89274-984a-4e44-a63c-534dca7709fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-6d840118-1d82-4f83-9cd8-b360542f2c6d" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-6d840118-1d82-4f83-9cd8-b360542f2c6d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-b4d89274-984a-4e44-a63c-534dca7709fd" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-b4d89274-984a-4e44-a63c-534dca7709fd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Deleting offline snapshot b4d89274-984a-4e44-a63c-534dca7709fd of volume 6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] snapshot_file for this snap is: volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b935f6de-b4a7-479e-a941-b2d0175abf46]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:51 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd Apr 15 23:22:51 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:51 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd" returned: 0 in 0.575s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d840118-1d82-4f83-9cd8-b360542f2c6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf4322e-83e9-4819-a469-d321c84a1c2e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:51 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d Apr 15 23:22:51 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:52 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d" returned: 0 in 0.654s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:52 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd Apr 15 23:22:52 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:53 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd" returned: 0 in 0.543s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:53 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd Apr 15 23:22:53 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=207,cinder:UPDATE=241,cinder:DELETE=19,cinder:INSERT=58 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Flow 'volume_create_manager' (527361fa-df83-4972-ac3a-a1723ab1c6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de487440-578d-48a4-871d-0c8bc66f116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de487440-578d-48a4-871d-0c8bc66f116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-398709644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fecfbf-5188-4398-a7e2-4efb61a56a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca630f3f1b6447a1b3f1a3eb6f1f11bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:53Z,use_quota=True,user_id='ff53712838b2412caed4bc17a9392290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326b6a9-3b72-4e39-a8cc-4026ac8b9eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326b6a9-3b72-4e39-a8cc-4026ac8b9eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46423803-73a3-44b0-9f21-5234949779af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46423803-73a3-44b0-9f21-5234949779af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fecfbf-5188-4398-a7e2-4efb61a56a84', 'volume_name': 'volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6818e424-6c06-491f-ae20-9b83c9c3f4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6818e424-6c06-491f-ae20-9b83c9c3f4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b96daf-9a96-484d-974c-473237a411d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:53 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Volume f2fecfbf-5188-4398-a7e2-4efb61a56a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84', 'volume_size': 1} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-398709644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fecfbf-5188-4398-a7e2-4efb61a56a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca630f3f1b6447a1b3f1a3eb6f1f11bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:53Z,use_quota=True,user_id='ff53712838b2412caed4bc17a9392290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Creating volume f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:53 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:53 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 1073741824 Apr 15 23:22:53 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:53 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d.b4d89274-984a-4e44-a63c-534dca7709fd" returned: 0 in 0.438s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-b4d89274-984a-4e44-a63c-534dca7709fd" released by "_delete_snapshot" :: held 2.270s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-6d840118-1d82-4f83-9cd8-b360542f2c6d" released by "delete_snapshot" :: held 2.281s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['7d480be4-b1fa-4ea0-887b-645faea74382', 'e16ad970-7dc9-4ecd-bfb6-be3941684b19', '66030945-9e72-41bc-a802-4c2b91c3f9d6', '739b2a9d-fb68-417a-8f22-b858899fa642'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:22:53 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Delete snapshot completed successfully. Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f39ddf51-77e2-4b13-aea2-55158b141511 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-b4d89274-984a-4e44-a63c-534dca7709fd-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:22:53 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 1073741824" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:53 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 Apr 15 23:22:53 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:54 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84" returned: 0 in 0.449s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b96daf-9a96-484d-974c-473237a411d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d7074a-424c-4af0-bcca-3f346d834d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:54 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Volume volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 (f2fecfbf-5188-4398-a7e2-4efb61a56a84): created successfully Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d7074a-424c-4af0-bcca-3f346d834d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Flow 'volume_create_manager' (527361fa-df83-4972-ac3a-a1723ab1c6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-239e7b7b-2b97-4218-b855-3d27c4740318 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Created volume successfully. Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (9f3a4acd-78a7-41f8-9990-235e11162392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d05ac94-ef38-4637-8c08-7cfea294946d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d05ac94-ef38-4637-8c08-7cfea294946d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-937875932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce68a288-c5a4-459f-aac4-52fe045c1bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:55Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c21bb-c470-42e7-98f2-330448b17eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c21bb-c470-42e7-98f2-330448b17eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf24e3f-7435-489f-b60b-48393aaeb492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf24e3f-7435-489f-b60b-48393aaeb492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce68a288-c5a4-459f-aac4-52fe045c1bf7', 'volume_name': 'volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9feb22-397f-44ce-975e-07bd7a525667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9feb22-397f-44ce-975e-07bd7a525667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd3ec7c-50e5-48f7-8426-1065d1d7621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:54 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Volume ce68a288-c5a4-459f-aac4-52fe045c1bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7', 'volume_size': 1} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-937875932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce68a288-c5a4-459f-aac4-52fe045c1bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:55Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Creating volume ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:22:54 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:22:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:54 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 1073741824 Apr 15 23:22:54 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:55 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 1073741824" returned: 0 in 0.530s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:55 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 Apr 15 23:22:55 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:55 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7" returned: 0 in 0.440s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.250s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Creating offline snapshot fee07fb8-2358-482b-a13a-828cdb328341 of volume f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd3ec7c-50e5-48f7-8426-1065d1d7621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc669d7d-7a4b-4446-b9e7-8ca1333c383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9827aa63-86cf-4279-af22-f63652af6d91]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:55 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Volume volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 (ce68a288-c5a4-459f-aac4-52fe045c1bf7): created successfully Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc669d7d-7a4b-4446-b9e7-8ca1333c383d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (9f3a4acd-78a7-41f8-9990-235e11162392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:55 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d8c954b2-e6bd-47ba-8f1b-0b44242ef641 tempest-VolumesSnapshotTestJSON-665282475 None] Created volume successfully. Apr 15 23:22:55 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 Apr 15 23:22:55 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:56 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84" returned: 0 in 0.485s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:56 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 1G Apr 15 23:22:56 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:56 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 1G" returned: 0 in 0.562s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:56 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 Apr 15 23:22:56 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:57 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341" returned: 0 in 0.489s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:57 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 is being set with open permissions: ugo+rw Apr 15 23:22:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:57 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 Apr 15 23:22:57 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:57 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341" returned: 0 in 0.443s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:57 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.info Apr 15 23:22:57 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:58 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.info" returned: 0 in 0.471s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:58 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.info is being set with open permissions: ugo+rw Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:58 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.info Apr 15 23:22:58 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:58 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.info" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.839s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Creating offline snapshot 84e3e212-f62d-4220-8a74-4a777dd7d7f9 of volume ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d557674-a836-441d-8e57-ea202c64f467]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:58 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-500f27d1-0a0a-428e-ba17-1f25a3419dfc tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Create snapshot completed successfully Apr 15 23:22:58 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 Apr 15 23:22:58 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:59 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7" returned: 0 in 0.579s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:59 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 1G Apr 15 23:22:59 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Flow 'volume_create_manager' (9ce762e6-38d9-4164-b9ff-06008e261cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e649bde5-cad2-42be-803e-55f3e60709f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e649bde5-cad2-42be-803e-55f3e60709f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1764165696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc48d03-5b53-45aa-b912-5defb3b4ed0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede7ddfde998481e848952ecdb517310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:59Z,use_quota=True,user_id='88d6d18e6ae940d7aebbf521824d9611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0c8275-ccfa-428f-9052-55263ca97f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0c8275-ccfa-428f-9052-55263ca97f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980d3ee6-85fd-4446-b1f0-c2a1edee4fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980d3ee6-85fd-4446-b1f0-c2a1edee4fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc48d03-5b53-45aa-b912-5defb3b4ed0a', 'volume_name': 'volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82e96f7-c4e7-4505-836f-19e78c92333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82e96f7-c4e7-4505-836f-19e78c92333b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e054e65a-bbf0-4bc0-be87-bd231f878fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:22:59 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Volume 4fc48d03-5b53-45aa-b912-5defb3b4ed0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a', 'volume_size': 1} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:22:59 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 1G" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:59 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 Apr 15 23:22:59 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "cinder-fee07fb8-2358-482b-a13a-828cdb328341-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-fee07fb8-2358-482b-a13a-828cdb328341-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "cinder-quobyte-f2fecfbf-5188-4398-a7e2-4efb61a56a84" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-quobyte-f2fecfbf-5188-4398-a7e2-4efb61a56a84" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "cinder-quobyte-fee07fb8-2358-482b-a13a-828cdb328341" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-quobyte-fee07fb8-2358-482b-a13a-828cdb328341" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Deleting offline snapshot fee07fb8-2358-482b-a13a-828cdb328341 of volume f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] snapshot_file for this snap is: volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[16024e48-644c-436c-b0ed-f719829e5729]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:22:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:22:59 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 Apr 15 23:22:59 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:00 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9" returned: 0 in 0.427s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:00 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 is being set with open permissions: ugo+rw Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:00 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 Apr 15 23:23:00 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:00 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341" returned: 0 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3298f02-7ab3-4b0e-b02c-1b093bc55eaa]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:00 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 Apr 15 23:23:00 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:00 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9" returned: 0 in 0.425s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:00 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.info Apr 15 23:23:00 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:00 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84" returned: 0 in 0.454s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:00 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 Apr 15 23:23:00 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:01 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.info" returned: 0 in 0.448s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:01 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.info is being set with open permissions: ugo+rw Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:01 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.info Apr 15 23:23:01 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:01 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:01 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341 Apr 15 23:23:01 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:01 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.info" returned: 0 in 0.432s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.108s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1764165696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc48d03-5b53-45aa-b912-5defb3b4ed0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede7ddfde998481e848952ecdb517310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:22:59Z,use_quota=True,user_id='88d6d18e6ae940d7aebbf521824d9611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Creating volume 4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:01 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:01 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a 1073741824 Apr 15 23:23:01 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-07a198b7-3aa6-42ec-bcbc-69cb58959620 tempest-VolumesSnapshotTestJSON-665282475 None] Create snapshot completed successfully Apr 15 23:23:01 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84.fee07fb8-2358-482b-a13a-828cdb328341" returned: 0 in 0.401s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-quobyte-fee07fb8-2358-482b-a13a-828cdb328341" released by "_delete_snapshot" :: held 1.858s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-quobyte-f2fecfbf-5188-4398-a7e2-4efb61a56a84" released by "delete_snapshot" :: held 1.871s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Created reservations ['8e41588e-2db2-4f52-910e-f1a204c7048e', '34378e18-18a5-47b0-9532-a4befb4d73bf', 'cd20e0e5-da4a-4a49-86e2-bd255d2cafef', 'ab9571de-f58d-4e1e-bb03-ad2c6bac050b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Delete snapshot completed successfully. Apr 15 23:23:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e52e77ee-dc4a-409d-93ad-dcfa63254087 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-fee07fb8-2358-482b-a13a-828cdb328341-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "cinder-f2fecfbf-5188-4398-a7e2-4efb61a56a84-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:02 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a 1073741824" returned: 0 in 0.544s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-f2fecfbf-5188-4398-a7e2-4efb61a56a84-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "cinder-quobyte-f2fecfbf-5188-4398-a7e2-4efb61a56a84" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:02 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-quobyte-f2fecfbf-5188-4398-a7e2-4efb61a56a84" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:02 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f529a2-9a81-4fe1-b5c6-8d623cb721b9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (36aaf25b-137a-469f-89fb-c5821261daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4882235d-6d0e-4ce8-9864-c957cad62c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:02 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 Apr 15 23:23:02 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4882235d-6d0e-4ce8-9864-c957cad62c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-639479689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1cbab50-1223-4bf7-bf59-b988f5ab2b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=84e3e212-f62d-4220-8a74-4a777dd7d7f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:02Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d57e6-a108-4047-ba99-db7ec99b4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d57e6-a108-4047-ba99-db7ec99b4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d38428-ff92-4816-9e6c-08bfd92f0134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d38428-ff92-4816-9e6c-08bfd92f0134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1cbab50-1223-4bf7-bf59-b988f5ab2b65', 'volume_name': 'volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65', 'volume_size': 2, 'snapshot_id': '84e3e212-f62d-4220-8a74-4a777dd7d7f9'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb38e3-6f5f-4d28-a3f5-e5ff9b741dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb38e3-6f5f-4d28-a3f5-e5ff9b741dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a69720a-17fc-48c8-a53b-fe56e32a647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:02 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Volume c1cbab50-1223-4bf7-bf59-b988f5ab2b65: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65', 'volume_size': 2, 'snapshot_id': '84e3e212-f62d-4220-8a74-4a777dd7d7f9'} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:02 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.439s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.224s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-84e3e212-f62d-4220-8a74-4a777dd7d7f9-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e054e65a-bbf0-4bc0-be87-bd231f878fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f469f6-0d75-4074-aca8-6a1b85bcb087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-84e3e212-f62d-4220-8a74-4a777dd7d7f9-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Creating volume c1cbab50-1223-4bf7-bf59-b988f5ab2b65 from snapshot 84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:02 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Volume volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a (4fc48d03-5b53-45aa-b912-5defb3b4ed0a): created successfully Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f469f6-0d75-4074-aca8-6a1b85bcb087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Flow 'volume_create_manager' (9ce762e6-38d9-4164-b9ff-06008e261cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] snapshot: 84e3e212-f62d-4220-8a74-4a777dd7d7f9, volume: c1cbab50-1223-4bf7-bf59-b988f5ab2b65, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:23:02 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a09517e6-f79f-443d-ab9f-a0d7a8881ed0 tempest-VolumesActionsTest-991374586 None] Created volume successfully. Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb0894-d9a6-4d9d-8153-cbdfb990d6e2]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:02 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 Apr 15 23:23:02 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:02 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84" returned: 0 in 0.529s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:02 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84 Apr 15 23:23:02 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:03 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9" returned: 0 in 0.490s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb0e819-1f11-4e1c-b676-47bfdecb61d1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:03 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f2fecfbf-5188-4398-a7e2-4efb61a56a84" returned: 0 in 0.440s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-quobyte-f2fecfbf-5188-4398-a7e2-4efb61a56a84" released by "delete_volume" :: held 1.059s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:03 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 Apr 15 23:23:03 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Created reservations ['581859cc-6963-4a83-90c1-76d177d24142', 'e7c3da0a-ca40-4a78-a986-e4399ee8eb6d', 'f4870519-2bfc-4050-8cf7-55a6158ddd68', '1df643aa-4021-42f5-8b39-c2b8749ef83e'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:03 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:03 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:03 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7" returned: 0 in 0.524s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:03 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 Apr 15 23:23:03 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:03 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.484s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:03 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Deleted volume successfully. Apr 15 23:23:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-74d885e4-106d-41cd-8e8a-62f9000a9ea0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936189048 None] Lock "cinder-f2fecfbf-5188-4398-a7e2-4efb61a56a84-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:05 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" returned: 0 in 2.259s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ac5894-7a24-459b-92f2-46e4c04c9791]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:06 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 Apr 15 23:23:06 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:06 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7" returned: 0 in 0.831s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:06 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:23:06 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Converted 1024.00 MB image at 453.10 MB/s Apr 15 23:23:06 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 is being set with open permissions: ugo+rw Apr 15 23:23:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:06 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 Apr 15 23:23:06 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:07 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" released by "_copy_volume_from_snapshot" :: held 4.703s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-84e3e212-f62d-4220-8a74-4a777dd7d7f9-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" released by "_create_volume_from_snapshot" :: held 4.737s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.755s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a69720a-17fc-48c8-a53b-fe56e32a647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65', 'volume_size': 2, 'snapshot_id': '84e3e212-f62d-4220-8a74-4a777dd7d7f9'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c16d72f-9ddb-467e-9408-37e2fac5f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:07 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Volume volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 (c1cbab50-1223-4bf7-bf59-b988f5ab2b65): created successfully Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c16d72f-9ddb-467e-9408-37e2fac5f05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (36aaf25b-137a-469f-89fb-c5821261daf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dc589d0e-13dd-41ea-b1a2-3e197a5b921b tempest-VolumesSnapshotTestJSON-665282475 None] Created volume successfully. Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-c1cbab50-1223-4bf7-bf59-b988f5ab2b65-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-c1cbab50-1223-4bf7-bf59-b988f5ab2b65-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1485b1-fb23-4ac5-a511-4b3d0e953894]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:07 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 Apr 15 23:23:07 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:08 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" returned: 0 in 0.550s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:08 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65 Apr 15 23:23:08 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:08 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" returned: 0 in 0.523s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-c1cbab50-1223-4bf7-bf59-b988f5ab2b65" released by "delete_volume" :: held 1.110s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:08 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['47e7711d-5611-4732-9909-237b133e01bd', '613d3ca9-edd6-4dcc-8d97-b8c004e816be', 'ef69b8cd-5701-4c41-b55d-5b879972ac43', 'ecc771c0-b3bc-4a3d-aa43-6ed47c9873dd'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:09 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:09 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:09 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:09 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Deleted volume successfully. Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-efb798bd-12d6-42e0-98e2-1bf5480dc7f8 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-c1cbab50-1223-4bf7-bf59-b988f5ab2b65-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-84e3e212-f62d-4220-8a74-4a777dd7d7f9-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-84e3e212-f62d-4220-8a74-4a777dd7d7f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-ce68a288-c5a4-459f-aac4-52fe045c1bf7" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-ce68a288-c5a4-459f-aac4-52fe045c1bf7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-84e3e212-f62d-4220-8a74-4a777dd7d7f9" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-84e3e212-f62d-4220-8a74-4a777dd7d7f9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Deleting offline snapshot 84e3e212-f62d-4220-8a74-4a777dd7d7f9 of volume ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] snapshot_file for this snap is: volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3a7f6-8962-4b8a-9e9e-f4ff0589a516]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:10 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 Apr 15 23:23:10 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:10 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9" returned: 0 in 0.592s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0997104b-b777-43a8-ba7f-a1ad442cb126]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:10 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 Apr 15 23:23:10 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:11 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7" returned: 0 in 0.612s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:11 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 Apr 15 23:23:11 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Flow 'volume_create_manager' (d8c48511-1a9a-417b-a175-fcb9d7900d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca47d5a-7e2b-4635-a09a-a466307f6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca47d5a-7e2b-4635-a09a-a466307f6b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1265724000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba06f11-4a70-450d-b55b-8bb3a1aca908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39930570cfc148eda7e0ea79d33f2e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:12Z,use_quota=True,user_id='f6b2bb1400044a33a93d302dc3e1d671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4608b93-9360-4a88-a1d2-7a965797e533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4608b93-9360-4a88-a1d2-7a965797e533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3191a1-2457-45e3-a642-ff14d68b4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.image.glance [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Creating Keystone auth plugin from conf {{(pid=82388) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 23:23:11 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9" returned: 0 in 0.559s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:11 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9 Apr 15 23:23:11 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3191a1-2457-45e3-a642-ff14d68b4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ba06f11-4a70-450d-b55b-8bb3a1aca908', 'volume_name': 'volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0ea1a7-4423-48a0-8a43-6509479cab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0ea1a7-4423-48a0-8a43-6509479cab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4499e2e3-e147-4966-8913-490383777ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:11 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Volume 4ba06f11-4a70-450d-b55b-8bb3a1aca908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 23:23:11 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Trying to clone 4ba06f11-4a70-450d-b55b-8bb3a1aca908 from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]). {{(pid=82388) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 23:23:12 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Image download 20.69 MB at 20.69 MB/s Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed35499-c844-4a61-aeb0-bc03bb564bd7]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:12 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD Apr 15 23:23:12 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:12 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7.84e3e212-f62d-4220-8a74-4a777dd7d7f9" returned: 0 in 0.556s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-84e3e212-f62d-4220-8a74-4a777dd7d7f9" released by "_delete_snapshot" :: held 2.382s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-ce68a288-c5a4-459f-aac4-52fe045c1bf7" released by "delete_snapshot" :: held 2.397s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['8d2009c5-5395-4fb3-b6f7-7e42da11c65c', '10533697-cdf2-4e91-8ac3-fc19b1f2c3af', 'a349f3fe-b73d-4685-a10a-7f7bfc9e97e9', '269b31f3-23d3-4cee-a9b7-888bbda60fd8'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Delete snapshot completed successfully. Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc4a3c90-22d6-4502-a397-92f1bb3f2b35 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-84e3e212-f62d-4220-8a74-4a777dd7d7f9-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:12 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 is fetched for user f6b2bb1400044a33a93d302dc3e1d671. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[117f2172-2a06-47d1-833d-075d317b388c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:12 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD Apr 15 23:23:12 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-ce68a288-c5a4-459f-aac4-52fe045c1bf7-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-ce68a288-c5a4-459f-aac4-52fe045c1bf7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-ce68a288-c5a4-459f-aac4-52fe045c1bf7" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-ce68a288-c5a4-459f-aac4-52fe045c1bf7" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc7bac1-c5f2-4224-b9f7-23683a46459c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:13 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1265724000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba06f11-4a70-450d-b55b-8bb3a1aca908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39930570cfc148eda7e0ea79d33f2e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:12Z,use_quota=True,user_id='f6b2bb1400044a33a93d302dc3e1d671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Creating volume 4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:13 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:13 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 1073741824 Apr 15 23:23:13 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:13 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 Apr 15 23:23:13 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:13 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:13 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7 Apr 15 23:23:13 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:13 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 1073741824" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:13 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 Apr 15 23:23:13 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:14 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ce68a288-c5a4-459f-aac4-52fe045c1bf7" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-ce68a288-c5a4-459f-aac4-52fe045c1bf7" released by "delete_volume" :: held 1.028s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['f9739be9-1d19-42e8-9728-1f7258b2a5c1', 'ba30041e-2878-4b11-beb9-ae1e9a687585', '2168ffc0-e04d-416f-85e3-c25ae6bb51a0', 'fa55f043-708e-4240-9f23-70274aeefe42'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:14 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908" returned: 0 in 0.505s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Attempting download of 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume 4ba06f11-4a70-450d-b55b-8bb3a1aca908. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 23:23:14 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:14 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063a4f6-f0e3-4e59-9d96-6d36062c0687]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_lmh2e3rl {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:14 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_lmh2e3rl Apr 15 23:23:14 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:14 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:14 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:14 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.453s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:14 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Deleted volume successfully. Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2227c70f-c61b-4d09-870d-ad53fdb0ac93 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-ce68a288-c5a4-459f-aac4-52fe045c1bf7-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:14 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_lmh2e3rl" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_lmh2e3rl {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:14 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_lmh2e3rl Apr 15 23:23:14 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:15 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.454s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:15 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_lmh2e3rl" returned: 1 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7964c2ec-4e08-4c1d-802c-6b54500d24d6_lmh2e3rl' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ab794-1741-41ab-9416-431c42a1e3b4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:15 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD Apr 15 23:23:15 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (a20d3472-23b4-49a1-9679-b7daa0184f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647b7c24-d331-4d67-bd47-59887e18d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647b7c24-d331-4d67-bd47-59887e18d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2004739263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e689cc4-c1e2-4b38-b341-d956da6a4f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:16Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49721ec5-1cc0-42b8-a3b8-f71c0a5920c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49721ec5-1cc0-42b8-a3b8-f71c0a5920c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fde077-2190-4aa8-843c-304e5a9f5840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fde077-2190-4aa8-843c-304e5a9f5840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e689cc4-c1e2-4b38-b341-d956da6a4f90', 'volume_name': 'volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463e1ef2-ce2b-4173-a805-2b7f5ce04550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463e1ef2-ce2b-4173-a805-2b7f5ce04550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2856f821-0b75-4df6-8b15-fd77b15a3356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:15 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Volume 4e689cc4-c1e2-4b38-b341-d956da6a4f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90', 'volume_size': 1} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2004739263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e689cc4-c1e2-4b38-b341-d956da6a4f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:16Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Creating volume 4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:15 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:15 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 1073741824 Apr 15 23:23:15 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:15 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] 7964c2ec-4e08-4c1d-802c-6b54500d24d6 was qcow2, converting to raw {{(pid=82388) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 23:23:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:15 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 Apr 15 23:23:15 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:16 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 1073741824" returned: 0 in 0.509s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:16 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 Apr 15 23:23:16 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:16 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90" returned: 0 in 0.649s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:23:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2856f821-0b75-4df6-8b15-fd77b15a3356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c1404c-0e93-4fdc-96f7-eb4540e8c749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:17 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:17 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Volume volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 (4e689cc4-c1e2-4b38-b341-d956da6a4f90): created successfully Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c1404c-0e93-4fdc-96f7-eb4540e8c749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (a20d3472-23b4-49a1-9679-b7daa0184f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908" returned: 0 in 1.093s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7964c2ec-4e08-4c1d-802c-6b54500d24d6_62kp7_zvdevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:23:17 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Converted 112.00 MB image at 102.39 MB/s Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:17 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1da41b47-cd00-4370-b44f-deed413273a2 tempest-VolumesSnapshotTestJSON-665282475 None] Created volume successfully. Apr 15 23:23:17 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 1G Apr 15 23:23:17 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:17 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 1G" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ad6463-1830-4604-a97d-f91cada994d1]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:17 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 Apr 15 23:23:17 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Creating offline snapshot 7b8799bc-403f-40a0-9f4d-ee0038184f59 of volume 4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a52fe0-25a7-4fa6-b4cd-3c9f252ff4ab]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:18 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 Apr 15 23:23:18 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:18 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908" returned: 0 in 0.509s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:18 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 Apr 15 23:23:18 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:18 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90" returned: 0 in 0.585s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:18 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 1G Apr 15 23:23:18 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:18 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908" returned: 1 in 0.492s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Downloaded image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}])) to volume 4ba06f11-4a70-450d-b55b-8bb3a1aca908 successfully. {{(pid=82388) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Temporary image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 for user f6b2bb1400044a33a93d302dc3e1d671 is deleted. {{(pid=82388) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.volume_utils [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Marking volume 4ba06f11-4a70-450d-b55b-8bb3a1aca908 as bootable. {{(pid=82388) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Copying metadata from image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 to 4ba06f11-4a70-450d-b55b-8bb3a1aca908. {{(pid=82388) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Creating volume glance metadata for volume 4ba06f11-4a70-450d-b55b-8bb3a1aca908 backed by image 7964c2ec-4e08-4c1d-802c-6b54500d24d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82388) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4499e2e3-e147-4966-8913-490383777ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908', 'volume_size': 1, 'image_id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d064521a09b4aba8a945c0d5c11ab78', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7964c2ec-4e08-4c1d-802c-6b54500d24d6', 'created_at': datetime.datetime(2026, 4, 15, 21, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 21, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7964c2ec-4e08-4c1d-802c-6b54500d24d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3622b28c-043f-47ff-a654-74ccb41f4d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:18 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Volume volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 (4ba06f11-4a70-450d-b55b-8bb3a1aca908): created successfully Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3622b28c-043f-47ff-a654-74ccb41f4d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Flow 'volume_create_manager' (d8c48511-1a9a-417b-a175-fcb9d7900d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-674da884-c2fa-4b98-a426-d1a4a0a7bea8 tempest-VolumesImageMetadata-2023024668 None] Created volume successfully. Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0d0f4253-7ae8-4d07-9f14-c7192ae8f5e7 tempest-VolumesActionsTest-991374586 None] Acquiring lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" by "attach_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0d0f4253-7ae8-4d07-9f14-c7192ae8f5e7 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" acquired by "attach_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-0d0f4253-7ae8-4d07-9f14-c7192ae8f5e7 tempest-VolumesActionsTest-991374586 None] Attaching volume 4fc48d03-5b53-45aa-b912-5defb3b4ed0a to instance dff7e431-df7d-4980-87a9-e39fd5154c54 at mountpoint /dev/vdb on host None. Apr 15 23:23:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-0d0f4253-7ae8-4d07-9f14-c7192ae8f5e7 tempest-VolumesActionsTest-991374586 None] Attach volume completed successfully. Apr 15 23:23:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-0d0f4253-7ae8-4d07-9f14-c7192ae8f5e7 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" released by "attach_volume" :: held 0.060s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:19 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 1G" returned: 0 in 0.580s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:19 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 Apr 15 23:23:19 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Acquiring lock "cinder-4ba06f11-4a70-450d-b55b-8bb3a1aca908-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Lock "cinder-4ba06f11-4a70-450d-b55b-8bb3a1aca908-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Acquiring lock "cinder-quobyte-4ba06f11-4a70-450d-b55b-8bb3a1aca908" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Lock "cinder-quobyte-4ba06f11-4a70-450d-b55b-8bb3a1aca908" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c6f386-1951-4ebe-80e3-8f54a2909df3]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3d10583d-e254-4c10-80cb-c739211f9815 tempest-VolumesActionsTest-991374586 None] Acquiring lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-detach_volume" by "detach_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:19 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 Apr 15 23:23:19 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3d10583d-e254-4c10-80cb-c739211f9815 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3d10583d-e254-4c10-80cb-c739211f9815 tempest-VolumesActionsTest-991374586 None] Detaching volume 4fc48d03-5b53-45aa-b912-5defb3b4ed0a from instance dff7e431-df7d-4980-87a9-e39fd5154c54. Apr 15 23:23:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3d10583d-e254-4c10-80cb-c739211f9815 tempest-VolumesActionsTest-991374586 None] Detach volume completed successfully. Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3d10583d-e254-4c10-80cb-c739211f9815 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:19 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:19 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 is being set with open permissions: ugo+rw Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:19 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 Apr 15 23:23:19 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:19 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908" returned: 0 in 0.484s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:19 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 Apr 15 23:23:19 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:20 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:20 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.info Apr 15 23:23:20 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:20 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908" returned: 1 in 0.592s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:20 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908 Apr 15 23:23:20 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:20 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.info" returned: 0 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:20 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.info is being set with open permissions: ugo+rw Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:20 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.info Apr 15 23:23:20 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:20 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4ba06f11-4a70-450d-b55b-8bb3a1aca908" returned: 0 in 0.440s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Lock "cinder-quobyte-4ba06f11-4a70-450d-b55b-8bb3a1aca908" released by "delete_volume" :: held 1.575s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Created reservations ['c4e4f1a1-2f1a-4ff1-a620-fe72b0ce4579', 'cd8898c7-ed5a-44aa-bb68-594471a73ac9', '3240fc8e-a70d-4e11-9f3c-b892f5db8b07', '2a32d965-2c2e-44e3-b1e2-d3121f6f506e'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:21 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.info" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:21 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:21 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:21 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7a44bcf8-be94-4b21-89ef-4524d7b5e39c tempest-VolumesSnapshotTestJSON-665282475 None] Create snapshot completed successfully Apr 15 23:23:21 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:21 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:21 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Deleted volume successfully. Apr 15 23:23:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f4fa4f89-5dd3-48b6-bb85-b7c15c52a633 tempest-VolumesImageMetadata-2023024668 None] Lock "cinder-4ba06f11-4a70-450d-b55b-8bb3a1aca908-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (189591db-f66b-46a9-a838-b09753f12594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f329560-027d-48fa-96ed-aade4b8b57a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f329560-027d-48fa-96ed-aade4b8b57a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-862811522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a868f9-d854-4f39-ac47-bd5da5385050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af64911b31c943edb0dd0de7961bb803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b8799bc-403f-40a0-9f4d-ee0038184f59,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:22Z,use_quota=True,user_id='60de85f1da3543159ff5d8fcf5ec7a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec0392d-3e35-4611-98d2-5cb35c7318ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec0392d-3e35-4611-98d2-5cb35c7318ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d698e782-4885-4512-b0cc-0a336b873112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d698e782-4885-4512-b0cc-0a336b873112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55a868f9-d854-4f39-ac47-bd5da5385050', 'volume_name': 'volume-55a868f9-d854-4f39-ac47-bd5da5385050', 'volume_size': 1, 'snapshot_id': '7b8799bc-403f-40a0-9f4d-ee0038184f59'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba4ca68-7352-4d25-aca2-00a40763c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba4ca68-7352-4d25-aca2-00a40763c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b0b0ce-4535-47ef-b380-6f186b2b5a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:22 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Volume 55a868f9-d854-4f39-ac47-bd5da5385050: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55a868f9-d854-4f39-ac47-bd5da5385050', 'volume_size': 1, 'snapshot_id': '7b8799bc-403f-40a0-9f4d-ee0038184f59'} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-7b8799bc-403f-40a0-9f4d-ee0038184f59-55a868f9-d854-4f39-ac47-bd5da5385050" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-7b8799bc-403f-40a0-9f4d-ee0038184f59-55a868f9-d854-4f39-ac47-bd5da5385050" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Creating volume 55a868f9-d854-4f39-ac47-bd5da5385050 from snapshot 7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-55a868f9-d854-4f39-ac47-bd5da5385050" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-55a868f9-d854-4f39-ac47-bd5da5385050" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] snapshot: 7b8799bc-403f-40a0-9f4d-ee0038184f59, volume: 55a868f9-d854-4f39-ac47-bd5da5385050, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d1bac-e809-46e2-988f-08a25405aad1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:22 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 Apr 15 23:23:22 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:23 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db2c9b6-7d8d-4a6f-88c7-b1274ce87515]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:23 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 Apr 15 23:23:23 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Flow 'volume_create_manager' (90c8ddf0-67a3-4714-b153-f6665eacdf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2911641-f44d-40f3-85da-02e28e85547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2911641-f44d-40f3-85da-02e28e85547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-365337881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db86453a-fe66-49be-b8e5-2e4eeda8a497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b5d9a6023b48de8b7a513e688b8b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:23Z,use_quota=True,user_id='ad7ff9ad52d247128a1ea8a03e01b3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f47c730-8f06-4128-b224-e6f649fd0965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f47c730-8f06-4128-b224-e6f649fd0965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a729b6-1f72-4f7d-be1a-c95f1d12bcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a729b6-1f72-4f7d-be1a-c95f1d12bcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db86453a-fe66-49be-b8e5-2e4eeda8a497', 'volume_name': 'volume-db86453a-fe66-49be-b8e5-2e4eeda8a497', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbf70cf-0d06-4253-8164-ed6fe33086e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbf70cf-0d06-4253-8164-ed6fe33086e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c6aa26-a3e4-4dd2-acb1-80037024f212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:23 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Volume db86453a-fe66-49be-b8e5-2e4eeda8a497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db86453a-fe66-49be-b8e5-2e4eeda8a497', 'volume_size': 1} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:23 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90" returned: 0 in 0.546s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:23:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:23 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 Apr 15 23:23:23 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:25 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050" returned: 0 in 2.065s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:25 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff6f0b3-608e-4971-a082-8f18754fe5ac]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:25 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 Apr 15 23:23:25 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:26 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90" returned: 0 in 0.590s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:23:26 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Converted 1024.00 MB image at 495.53 MB/s Apr 15 23:23:26 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 is being set with open permissions: ugo+rw Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:26 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 Apr 15 23:23:26 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:26 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050" returned: 0 in 0.443s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-55a868f9-d854-4f39-ac47-bd5da5385050" released by "_copy_volume_from_snapshot" :: held 4.290s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-7b8799bc-403f-40a0-9f4d-ee0038184f59-55a868f9-d854-4f39-ac47-bd5da5385050" released by "_create_volume_from_snapshot" :: held 4.322s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.331s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-365337881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db86453a-fe66-49be-b8e5-2e4eeda8a497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82b5d9a6023b48de8b7a513e688b8b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:23Z,use_quota=True,user_id='ad7ff9ad52d247128a1ea8a03e01b3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Creating volume db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:26 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:26 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 1073741824 Apr 15 23:23:26 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b0b0ce-4535-47ef-b380-6f186b2b5a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a868f9-d854-4f39-ac47-bd5da5385050', 'volume_size': 1, 'snapshot_id': '7b8799bc-403f-40a0-9f4d-ee0038184f59'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbebfae-3724-475e-aad7-bc9e8226a386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Volume volume-55a868f9-d854-4f39-ac47-bd5da5385050 (55a868f9-d854-4f39-ac47-bd5da5385050): created successfully Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbebfae-3724-475e-aad7-bc9e8226a386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Flow 'volume_create_manager' (189591db-f66b-46a9-a838-b09753f12594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a2911d3c-2f82-44f4-ba24-b0f9b0ec4a77 tempest-VolumesSnapshotTestJSON-665282475 None] Created volume successfully. Apr 15 23:23:27 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 1073741824" returned: 0 in 0.540s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:27 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 Apr 15 23:23:27 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-55a868f9-d854-4f39-ac47-bd5da5385050-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-55a868f9-d854-4f39-ac47-bd5da5385050-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:27 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c6aa26-a3e4-4dd2-acb1-80037024f212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db86453a-fe66-49be-b8e5-2e4eeda8a497', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74158d34-998b-4544-a189-34a235c6c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Volume volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 (db86453a-fe66-49be-b8e5-2e4eeda8a497): created successfully Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74158d34-998b-4544-a189-34a235c6c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Flow 'volume_create_manager' (90c8ddf0-67a3-4714-b153-f6665eacdf8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-55a868f9-d854-4f39-ac47-bd5da5385050" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6faf4902-f70b-4483-9f1f-9bc2410a6096 tempest-SnapshotMetadataTestJSON-356811138 None] Created volume successfully. Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-55a868f9-d854-4f39-ac47-bd5da5385050" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[30314192-2ccf-460f-87a7-5a2214290aab]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:28 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 Apr 15 23:23:28 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:28 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050" returned: 0 in 0.465s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:28 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050 Apr 15 23:23:28 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:28 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-55a868f9-d854-4f39-ac47-bd5da5385050" returned: 0 in 0.427s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-55a868f9-d854-4f39-ac47-bd5da5385050" released by "delete_volume" :: held 0.916s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Creating offline snapshot 60c94b5f-72b0-4419-aa5c-be16f64db028 of volume db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf66152-aadf-4c1b-b958-16d6908c3c61]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['c8503fa8-538f-4cff-85bf-04bbd307fdbc', '93bdade6-59c9-45ad-86c9-e0ea1e4978e8', '6a7a387c-e7da-486d-803c-5168a1b28e35', 'cbf69ed8-29a0-4316-bd11-aaeeee126945'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:28 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 Apr 15 23:23:28 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:28 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:28 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-7b8799bc-403f-40a0-9f4d-ee0038184f59-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-7b8799bc-403f-40a0-9f4d-ee0038184f59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-4e689cc4-c1e2-4b38-b341-d956da6a4f90" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-4e689cc4-c1e2-4b38-b341-d956da6a4f90" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-7b8799bc-403f-40a0-9f4d-ee0038184f59" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-7b8799bc-403f-40a0-9f4d-ee0038184f59" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Deleting offline snapshot 7b8799bc-403f-40a0-9f4d-ee0038184f59 of volume 4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] snapshot_file for this snap is: volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86606d1-11ca-437e-a5dc-cc49432b5141]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:29 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 Apr 15 23:23:29 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:29 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497" returned: 0 in 0.511s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:29 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 1G Apr 15 23:23:29 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:29 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.484s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Deleted volume successfully. Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a999e758-5075-4511-bd6c-dd2449787d55 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-55a868f9-d854-4f39-ac47-bd5da5385050-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:29 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59" returned: 0 in 0.499s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe3903d-5cc6-4a1d-8d5c-e96efa6619a4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:29 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 Apr 15 23:23:29 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:29 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 1G" returned: 0 in 0.535s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:29 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 Apr 15 23:23:29 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:30 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90" returned: 0 in 0.461s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:30 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 Apr 15 23:23:30 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:30 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028" returned: 0 in 0.437s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:30 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 is being set with open permissions: ugo+rw Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:30 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 Apr 15 23:23:30 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:30 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59" returned: 0 in 0.463s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:30 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59 Apr 15 23:23:30 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:30 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028" returned: 0 in 0.430s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:30 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.info Apr 15 23:23:30 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:30 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90.7b8799bc-403f-40a0-9f4d-ee0038184f59" returned: 0 in 0.403s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-7b8799bc-403f-40a0-9f4d-ee0038184f59" released by "_delete_snapshot" :: held 1.888s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-4e689cc4-c1e2-4b38-b341-d956da6a4f90" released by "delete_snapshot" :: held 1.903s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:30 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['fb58aeda-e643-4c96-825c-bcc803d36f4b', 'df039f49-40cb-4e2e-8ce0-476998eedc72', 'c2bffbb1-8265-4d76-a8ff-df75fb256c5b', '76953c77-5811-4bfc-9d38-04ec2c1bef3b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Delete snapshot completed successfully. Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd6ac8bf-f84e-408b-b07f-0c3291e84002 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-7b8799bc-403f-40a0-9f4d-ee0038184f59-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-4e689cc4-c1e2-4b38-b341-d956da6a4f90-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-4e689cc4-c1e2-4b38-b341-d956da6a4f90-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-4e689cc4-c1e2-4b38-b341-d956da6a4f90" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-4e689cc4-c1e2-4b38-b341-d956da6a4f90" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:31 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.info" returned: 0 in 0.489s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:31 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.info is being set with open permissions: ugo+rw Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9892133b-1bee-402c-b99a-876ec4e9b4d7]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:31 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.info Apr 15 23:23:31 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:31 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 Apr 15 23:23:31 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:31 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.info" returned: 0 in 0.437s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7d69c637-cd20-4f8b-bf6d-dbcf5c4140d6 tempest-SnapshotMetadataTestJSON-356811138 None] Create snapshot completed successfully Apr 15 23:23:31 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90" returned: 0 in 0.566s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:31 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90 Apr 15 23:23:31 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:32 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "cinder-60c94b5f-72b0-4419-aa5c-be16f64db028-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4e689cc4-c1e2-4b38-b341-d956da6a4f90" returned: 0 in 0.584s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-60c94b5f-72b0-4419-aa5c-be16f64db028-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "cinder-quobyte-db86453a-fe66-49be-b8e5-2e4eeda8a497" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-4e689cc4-c1e2-4b38-b341-d956da6a4f90" released by "delete_volume" :: held 1.212s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-quobyte-db86453a-fe66-49be-b8e5-2e4eeda8a497" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "cinder-quobyte-60c94b5f-72b0-4419-aa5c-be16f64db028" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-quobyte-60c94b5f-72b0-4419-aa5c-be16f64db028" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Deleting offline snapshot 60c94b5f-72b0-4419-aa5c-be16f64db028 of volume db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] snapshot_file for this snap is: volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['5a13b68d-461a-45cf-9980-d6fc1716aa82', '16588586-e615-4c78-8d01-3c2040fdbeb8', '737a73cc-bb22-4c5c-9d31-f2592899399b', '27a65a26-a945-4f3d-b027-ad0fc7f03d8f'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb8dbe-2d2f-46ca-aeb6-0892cdd6f2a2]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:32 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 Apr 15 23:23:32 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:32 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:32 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:32 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Deleted volume successfully. Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f89e04ab-02f7-4062-b92b-7668940aa374 tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-4e689cc4-c1e2-4b38-b341-d956da6a4f90-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:33 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028" returned: 0 in 0.502s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db86453a-fe66-49be-b8e5-2e4eeda8a497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d91a8-d59a-4adc-8dd7-95c08c27321d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:33 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 Apr 15 23:23:33 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-6d840118-1d82-4f83-9cd8-b360542f2c6d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-6d840118-1d82-4f83-9cd8-b360542f2c6d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "cinder-quobyte-6d840118-1d82-4f83-9cd8-b360542f2c6d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-6d840118-1d82-4f83-9cd8-b360542f2c6d" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76facf-3136-41c6-9d9c-9467d6b47f02]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:33 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497" returned: 0 in 0.547s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:33 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d Apr 15 23:23:33 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:33 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 Apr 15 23:23:33 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:34 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d" returned: 0 in 0.488s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:34 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d Apr 15 23:23:34 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:34 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028" returned: 0 in 0.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:34 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028 Apr 15 23:23:34 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:34 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6d840118-1d82-4f83-9cd8-b360542f2c6d" returned: 0 in 0.433s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-quobyte-6d840118-1d82-4f83-9cd8-b360542f2c6d" released by "delete_volume" :: held 0.957s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:34 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497.60c94b5f-72b0-4419-aa5c-be16f64db028" returned: 0 in 0.434s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Created reservations ['26df4525-366e-4421-9f63-8800baa063a9', 'e78aced7-4e8f-4996-8ffb-131923aad6ef', '7f3cf6a4-d286-4fde-a0c3-2012b91ac885', '56a55502-31c7-498d-a0b8-5f24c72c580b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-quobyte-60c94b5f-72b0-4419-aa5c-be16f64db028" released by "_delete_snapshot" :: held 2.023s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-quobyte-db86453a-fe66-49be-b8e5-2e4eeda8a497" released by "delete_snapshot" :: held 2.050s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Created reservations ['cda70520-4d91-4406-b061-919cf3908695', '6143789e-cc04-45a4-a7d2-582cf2b88a9f', '50e7f9f7-8e13-4562-b62f-b179c0cacd86', 'bf146436-6f24-4e2b-b0a9-dcae0ad112ae'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:34 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:34 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:34 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Delete snapshot completed successfully. Apr 15 23:23:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2917896-2807-420e-a6be-da0512d86fac tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-60c94b5f-72b0-4419-aa5c-be16f64db028-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:35 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.422s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:35 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Deleted volume successfully. Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-db951bc8-5069-4115-8117-656062d5130e tempest-VolumesSnapshotTestJSON-665282475 None] Lock "cinder-6d840118-1d82-4f83-9cd8-b360542f2c6d-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "cinder-db86453a-fe66-49be-b8e5-2e4eeda8a497-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-db86453a-fe66-49be-b8e5-2e4eeda8a497-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "cinder-quobyte-db86453a-fe66-49be-b8e5-2e4eeda8a497" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-quobyte-db86453a-fe66-49be-b8e5-2e4eeda8a497" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb6a78d-545b-4d88-9a51-d01b963f5352]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:35 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 Apr 15 23:23:35 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:36 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497" returned: 0 in 0.520s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:36 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497 Apr 15 23:23:36 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:36 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-db86453a-fe66-49be-b8e5-2e4eeda8a497" returned: 0 in 0.453s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-quobyte-db86453a-fe66-49be-b8e5-2e4eeda8a497" released by "delete_volume" :: held 1.004s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Created reservations ['e9861435-5ac4-40a1-9ccd-a38cb447ed7d', '81defefb-bdce-4325-b8b2-53b10ee88df1', '574da605-ef2f-4bbb-b9c1-0381e61b82c4', '1f189bce-1793-4d91-bb00-f7ef64accc60'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:36 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:36 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:37 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.624s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:37 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:37 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Deleted volume successfully. Apr 15 23:23:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cd791758-b892-4cd5-bcb7-19cfa4c65af2 tempest-SnapshotMetadataTestJSON-356811138 None] Lock "cinder-db86453a-fe66-49be-b8e5-2e4eeda8a497-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Flow 'volume_create_manager' (7e0bcb9b-c299-405e-9a73-33f542bd7897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4249c9-7d51-4e38-8aa4-2c29f6834f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4249c9-7d51-4e38-8aa4-2c29f6834f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1714681585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765d6143-0a7e-4a82-96a8-2f906a0167ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2e54402a6a4b36a406f36bb410632f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:40Z,use_quota=True,user_id='c2e90cd634db43378a5106d6e6c8c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809b202f-d0f9-4e38-8884-e311c8fa92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809b202f-d0f9-4e38-8884-e311c8fa92f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90baec03-c982-4df6-aa22-c6209c399278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90baec03-c982-4df6-aa22-c6209c399278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765d6143-0a7e-4a82-96a8-2f906a0167ee', 'volume_name': 'volume-765d6143-0a7e-4a82-96a8-2f906a0167ee', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c94065-b887-4fb3-9c04-872477f66d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c94065-b887-4fb3-9c04-872477f66d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb0151a-c308-4255-b2eb-584da6265afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Volume 765d6143-0a7e-4a82-96a8-2f906a0167ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765d6143-0a7e-4a82-96a8-2f906a0167ee', 'volume_size': 1} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1714681585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765d6143-0a7e-4a82-96a8-2f906a0167ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2e54402a6a4b36a406f36bb410632f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:40Z,use_quota=True,user_id='c2e90cd634db43378a5106d6e6c8c44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Creating volume 765d6143-0a7e-4a82-96a8-2f906a0167ee {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:40 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:40 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee 1073741824 Apr 15 23:23:40 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-803cae61-5fe1-4cd0-af9e-54409e46ccfb tempest-VolumesActionsTest-991374586 None] Acquiring lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" by "attach_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-803cae61-5fe1-4cd0-af9e-54409e46ccfb tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" acquired by "attach_volume" :: waited 0.026s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Flow 'volume_create_manager' (290c0237-b58a-4cdf-a46a-68d2f3fd9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98d3669-f43e-4b92-b678-66fa2fbc6e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98d3669-f43e-4b92-b678-66fa2fbc6e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-661125747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30817c9-4c1a-4b1c-abf7-36d93d41717d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42745d6feb545aeb78a6811fcfd8ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:40Z,use_quota=True,user_id='5bf71372b9744e3f95ce823272ee306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34b7abd-457d-415f-8e9b-de049cf5ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34b7abd-457d-415f-8e9b-de049cf5ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353e592d-0fa9-4972-b30d-cc88c8f2a7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353e592d-0fa9-4972-b30d-cc88c8f2a7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30817c9-4c1a-4b1c-abf7-36d93d41717d', 'volume_name': 'volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e801b2-3c93-4927-969c-e5074ce3124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e801b2-3c93-4927-969c-e5074ce3124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11529f3b-4adc-4c58-b6d6-114d898d3993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:40 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Volume c30817c9-4c1a-4b1c-abf7-36d93d41717d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d', 'volume_size': 1} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-803cae61-5fe1-4cd0-af9e-54409e46ccfb tempest-VolumesActionsTest-991374586 None] Attaching volume 4fc48d03-5b53-45aa-b912-5defb3b4ed0a to instance d6b7cb32-be2c-4272-92d3-ee4d7153e183 at mountpoint /dev/vdb on host None. Apr 15 23:23:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-803cae61-5fe1-4cd0-af9e-54409e46ccfb tempest-VolumesActionsTest-991374586 None] Attach volume completed successfully. Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-803cae61-5fe1-4cd0-af9e-54409e46ccfb tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" released by "attach_volume" :: held 0.155s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:40 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee 1073741824" returned: 0 in 0.575s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:40 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee Apr 15 23:23:40 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-088032ef-9ad9-4606-b027-6f0601a4f204 tempest-VolumesActionsTest-991374586 None] Acquiring lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-detach_volume" by "detach_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-088032ef-9ad9-4606-b027-6f0601a4f204 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-088032ef-9ad9-4606-b027-6f0601a4f204 tempest-VolumesActionsTest-991374586 None] Detaching volume 4fc48d03-5b53-45aa-b912-5defb3b4ed0a from instance d6b7cb32-be2c-4272-92d3-ee4d7153e183. Apr 15 23:23:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-088032ef-9ad9-4606-b027-6f0601a4f204 tempest-VolumesActionsTest-991374586 None] Detach volume completed successfully. Apr 15 23:23:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-088032ef-9ad9-4606-b027-6f0601a4f204 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:41 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee" returned: 0 in 0.402s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-661125747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30817c9-4c1a-4b1c-abf7-36d93d41717d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42745d6feb545aeb78a6811fcfd8ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:40Z,use_quota=True,user_id='5bf71372b9744e3f95ce823272ee306f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Creating volume c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:41 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb0151a-c308-4255-b2eb-584da6265afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765d6143-0a7e-4a82-96a8-2f906a0167ee', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8b2881-96c1-48d1-a1a1-70216474b70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:41 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d 1073741824 Apr 15 23:23:41 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:41 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Volume volume-765d6143-0a7e-4a82-96a8-2f906a0167ee (765d6143-0a7e-4a82-96a8-2f906a0167ee): created successfully Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8b2881-96c1-48d1-a1a1-70216474b70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Flow 'volume_create_manager' (7e0bcb9b-c299-405e-9a73-33f542bd7897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:41 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a385c5e6-2758-473b-b269-1b614a147060 tempest-VolumesMetadataTest-1178181082 None] Created volume successfully. Apr 15 23:23:41 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d 1073741824" returned: 0 in 0.583s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:41 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d Apr 15 23:23:41 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:42 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d" returned: 0 in 0.431s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=168,cinder:SELECT=148,cinder:INSERT=47,cinder:DELETE=16 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11529f3b-4adc-4c58-b6d6-114d898d3993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152ec48a-19c9-4d8b-a1f3-596a84de2225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:42 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Volume volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d (c30817c9-4c1a-4b1c-abf7-36d93d41717d): created successfully Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152ec48a-19c9-4d8b-a1f3-596a84de2225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Flow 'volume_create_manager' (290c0237-b58a-4cdf-a46a-68d2f3fd9a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:42 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-aed9f92f-a2f9-46be-8f9a-def79d1a0dac tempest-VolumesSnapshotListTestJSON-1892188322 None] Created volume successfully. Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Creating offline snapshot 7ba90132-2686-4770-b21b-c10c49991622 of volume c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1133bd53-8b05-4b97-ac55-65d1f0fe01f1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:42 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d Apr 15 23:23:42 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Acquiring lock "cinder-765d6143-0a7e-4a82-96a8-2f906a0167ee-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Lock "cinder-765d6143-0a7e-4a82-96a8-2f906a0167ee-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Acquiring lock "cinder-quobyte-765d6143-0a7e-4a82-96a8-2f906a0167ee" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Lock "cinder-quobyte-765d6143-0a7e-4a82-96a8-2f906a0167ee" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c0ec2f-3752-442c-822c-6a04cee41be5]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:42 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee Apr 15 23:23:42 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:43 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d" returned: 0 in 0.620s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:43 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 1G Apr 15 23:23:43 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:43 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee" returned: 0 in 0.580s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:43 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee Apr 15 23:23:43 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:43 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 1G" returned: 0 in 0.531s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:43 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 Apr 15 23:23:43 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:43 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-765d6143-0a7e-4a82-96a8-2f906a0167ee" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Lock "cinder-quobyte-765d6143-0a7e-4a82-96a8-2f906a0167ee" released by "delete_volume" :: held 1.096s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Created reservations ['0f66a71b-2450-4574-81ee-99cfd86cba03', '2c9a5cb3-c0cb-4e52-8bd6-3d94e9bd301d', '1a1ec2cd-503d-474d-9e56-d628ae4d4f85', 'a72695bd-45c7-4ca8-a35a-a7d847f97c0e'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:44 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:44 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:44 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622" returned: 0 in 0.494s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:44 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 is being set with open permissions: ugo+rw Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:44 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 Apr 15 23:23:44 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:44 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Deleted volume successfully. Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dfcd36fb-7972-4bd3-afe2-0153a5f6c1ee tempest-VolumesMetadataTest-1178181082 None] Lock "cinder-765d6143-0a7e-4a82-96a8-2f906a0167ee-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:44 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622" returned: 0 in 0.439s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:44 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.info Apr 15 23:23:44 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:45 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.info" returned: 0 in 0.485s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:45 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.info is being set with open permissions: ugo+rw Apr 15 23:23:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:45 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.info Apr 15 23:23:45 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:45 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.info" returned: 0 in 0.502s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.167s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:45 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6951313b-0786-4fe4-a35d-6f636830588a tempest-VolumesSnapshotListTestJSON-1892188322 None] Create snapshot completed successfully Apr 15 23:23:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Creating offline snapshot bffad3f8-47dd-48e6-b54b-4929e66d7cdd of volume c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:23:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f8cc6-7a56-4940-b781-8ac96928faf7]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:46 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 Apr 15 23:23:46 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:47 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622" returned: 0 in 0.547s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:47 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd 1G Apr 15 23:23:47 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Flow 'volume_create_manager' (77b434d3-0a81-432c-83b7-a9ee82800b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b04c613-5269-410c-b214-e8b0dde72c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b04c613-5269-410c-b214-e8b0dde72c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1877493383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf80bd8-dc36-4aa0-99f8-8dab783b219e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66d1969beb8412f9caa2772608c3816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:48Z,use_quota=True,user_id='1182afb0148342a4afb4a2b9d85e177c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5864d58c-ff64-438d-8e51-94923649f2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5864d58c-ff64-438d-8e51-94923649f2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bee1c4-41a1-44cd-9162-dc7256ef5065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bee1c4-41a1-44cd-9162-dc7256ef5065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf80bd8-dc36-4aa0-99f8-8dab783b219e', 'volume_name': 'volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531f16fa-91fc-4a6b-8246-c73e8d913dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531f16fa-91fc-4a6b-8246-c73e8d913dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81b265d-e336-4382-802b-66c1774b4de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:47 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Volume dbf80bd8-dc36-4aa0-99f8-8dab783b219e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e', 'volume_size': 1} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:47 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd 1G" returned: 0 in 0.607s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:48 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd Apr 15 23:23:48 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:48 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:48 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd is being set with open permissions: ugo+rw Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:48 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd Apr 15 23:23:48 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:48 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd" returned: 0 in 0.441s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1877493383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf80bd8-dc36-4aa0-99f8-8dab783b219e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66d1969beb8412f9caa2772608c3816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:48Z,use_quota=True,user_id='1182afb0148342a4afb4a2b9d85e177c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Creating volume dbf80bd8-dc36-4aa0-99f8-8dab783b219e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:23:48 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:23:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:48 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e 1073741824 Apr 15 23:23:48 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:48 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c7194b4e-8c50-4da8-8fd7-3a3907ee7ce4 tempest-VolumesSnapshotListTestJSON-1892188322 None] Create snapshot completed successfully Apr 15 23:23:49 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e 1073741824" returned: 0 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:49 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e Apr 15 23:23:49 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:49 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e" returned: 0 in 0.432s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.201s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81b265d-e336-4382-802b-66c1774b4de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd819f8-8acc-4556-b411-e5be7ba4f67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a337b508-fa19-4505-a2e1-8f49b18b905a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:49 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Volume volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e (dbf80bd8-dc36-4aa0-99f8-8dab783b219e): created successfully Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd819f8-8acc-4556-b411-e5be7ba4f67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Flow 'volume_create_manager' (77b434d3-0a81-432c-83b7-a9ee82800b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:49 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f2320750-b0f4-4301-92c9-649e2b0840d7 tempest-VolumesTransfersTest-442635709 None] Created volume successfully. Apr 15 23:23:50 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:23:50 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:50 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.495s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:50 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9691ad25-e4ae-4eb4-8463-4f8cabb04ca4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:50 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:23:50 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:50 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.553s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.966a1777-72ce-4ee0-86c0-b9d193714f4d8zc3vzfs.img {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:51 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.966a1777-72ce-4ee0-86c0-b9d193714f4d8zc3vzfs.img Apr 15 23:23:51 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:51 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fb072227-02b4-4849-b5ae-3f45854ec530 tempest-VolumesTransfersTest-1658149555 None] Transfer volume completed successfully. Apr 15 23:23:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Acquiring lock "cinder-dbf80bd8-dc36-4aa0-99f8-8dab783b219e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-dbf80bd8-dc36-4aa0-99f8-8dab783b219e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Acquiring lock "cinder-quobyte-dbf80bd8-dc36-4aa0-99f8-8dab783b219e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:23:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-quobyte-dbf80bd8-dc36-4aa0-99f8-8dab783b219e" acquired by "delete_volume" :: waited 0.039s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:23:52 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc22d29-1fa6-407d-a829-e851e68efb4b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:52 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e Apr 15 23:23:52 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:53 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.966a1777-72ce-4ee0-86c0-b9d193714f4d8zc3vzfs.img" returned: 0 in 2.144s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea34b4bc-6f68-49d1-a457-61df60534567]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:53 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:23:53 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:53 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e" returned: 0 in 1.015s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:53 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e Apr 15 23:23:53 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:53 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.591s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.966a1777-72ce-4ee0-86c0-b9d193714f4d8zc3vzfs.img {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:23:53 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Converted 1024.00 MB image at 477.29 MB/s Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] 966a1777-72ce-4ee0-86c0-b9d193714f4d was raw, no need to convert to raw {{(pid=82388) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 23:23:53 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-dbf80bd8-dc36-4aa0-99f8-8dab783b219e" returned: 0 in 0.421s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-quobyte-dbf80bd8-dc36-4aa0-99f8-8dab783b219e" released by "delete_volume" :: held 1.477s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=145,cinder:INSERT=43,cinder:UPDATE=151,cinder:DELETE=11 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Created reservations ['463ee23c-cfd0-4c1f-9e80-fae123b66d43', 'c76654f3-14e0-4d59-a5b5-c58c97809c83', '462d0539-8da2-46c8-9241-46d2a52d581c', '89120fd5-a564-4926-9e0d-3590b881bde4'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:23:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:23:53 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:23:53 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:23:54 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.465s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:23:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Deleted volume successfully. Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7e9f0eae-6086-4bbc-b0b2-adb0e4cd74cb tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-dbf80bd8-dc36-4aa0-99f8-8dab783b219e-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Flow 'volume_create_manager' (d76b6eb5-61d1-48db-92c0-fd1fe1a2a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d15f68-f2aa-4645-8bbb-e9e8999fb5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d15f68-f2aa-4645-8bbb-e9e8999fb5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-567987978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb90d57-462d-41c0-920b-6d44faa4dbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66d1969beb8412f9caa2772608c3816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:55Z,use_quota=True,user_id='1182afb0148342a4afb4a2b9d85e177c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39c5f17-7613-470d-97db-c5415ffcd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39c5f17-7613-470d-97db-c5415ffcd990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abf0939-f676-4dae-85fb-b90eeafc1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abf0939-f676-4dae-85fb-b90eeafc1927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb90d57-462d-41c0-920b-6d44faa4dbc4', 'volume_name': 'volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e21fad-65a5-4a3f-aabf-000ce9198209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e21fad-65a5-4a3f-aabf-000ce9198209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc71dd4f-ac0b-49ba-bd09-99c586a08a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:23:54 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Volume bcb90d57-462d-41c0-920b-6d44faa4dbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4', 'volume_size': 1} Apr 15 23:23:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.111s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Uploaded volume to glance image-id: 966a1777-72ce-4ee0-86c0-b9d193714f4d. {{(pid=82388) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.014s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Creating offline snapshot 336bcffb-59f3-44ae-b1fc-4a347ec56e2c of volume c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d1953c-89bd-4e2f-bc8e-a09c842732bb]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:03 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dd7fbea3-7634-4782-8483-e15d9b645b4f tempest-VolumesActionsTest-991374586 None] Copy volume to image completed successfully. Apr 15 23:24:03 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd Apr 15 23:24:03 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:03 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:03 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c 1G Apr 15 23:24:03 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:04 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c 1G" returned: 0 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:04 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c Apr 15 23:24:04 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:04 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c" returned: 0 in 0.414s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:04 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c is being set with open permissions: ugo+rw Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:04 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c Apr 15 23:24:04 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:04 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c" returned: 0 in 0.388s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.158s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-567987978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb90d57-462d-41c0-920b-6d44faa4dbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66d1969beb8412f9caa2772608c3816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:23:55Z,use_quota=True,user_id='1182afb0148342a4afb4a2b9d85e177c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Creating volume bcb90d57-462d-41c0-920b-6d44faa4dbc4 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:04 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:04 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 1073741824 Apr 15 23:24:04 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:04 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e6d62d7e-cdd4-4d45-94df-268fabc91237 tempest-VolumesSnapshotListTestJSON-1892188322 None] Create snapshot completed successfully Apr 15 23:24:05 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 1073741824" returned: 0 in 0.474s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:05 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 Apr 15 23:24:05 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:05 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4" returned: 0 in 0.387s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.143s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c590b202-c377-4f57-8338-9bafce36d948]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc71dd4f-ac0b-49ba-bd09-99c586a08a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6813c5-0fa8-42e4-8a8a-7c1c94725efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:05 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Volume volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 (bcb90d57-462d-41c0-920b-6d44faa4dbc4): created successfully Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6813c5-0fa8-42e4-8a8a-7c1c94725efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Flow 'volume_create_manager' (d76b6eb5-61d1-48db-92c0-fd1fe1a2a848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-bd226571-fdf3-4a62-afed-cdea09a37961 tempest-VolumesTransfersTest-442635709 None] Created volume successfully. Apr 15 23:24:05 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:24:05 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-336bcffb-59f3-44ae-b1fc-4a347ec56e2c-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-336bcffb-59f3-44ae-b1fc-4a347ec56e2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-quobyte-336bcffb-59f3-44ae-b1fc-4a347ec56e2c" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-336bcffb-59f3-44ae-b1fc-4a347ec56e2c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Deleting offline snapshot 336bcffb-59f3-44ae-b1fc-4a347ec56e2c of volume c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] snapshot_file for this snap is: volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[444789bb-b2d4-4e4d-a16d-ba6ec96331f3]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:06 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.525s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:06 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c Apr 15 23:24:06 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c9ea61-0cb6-4f9e-bc96-72e81b71ab93]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:06 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:24:06 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Acquiring lock "cinder-bcb90d57-462d-41c0-920b-6d44faa4dbc4-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-bcb90d57-462d-41c0-920b-6d44faa4dbc4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Acquiring lock "cinder-quobyte-bcb90d57-462d-41c0-920b-6d44faa4dbc4" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-quobyte-bcb90d57-462d-41c0-920b-6d44faa4dbc4" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7563a22b-ecab-4482-9e2a-026472f7aa83]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:06 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 Apr 15 23:24:06 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:06 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c" returned: 0 in 0.507s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3586f3ec-6e0f-4b4f-b806-d7c966371786]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:06 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd Apr 15 23:24:06 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:06 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.539s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:06 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img Apr 15 23:24:06 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:07 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4" returned: 0 in 0.484s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:07 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4 Apr 15 23:24:07 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:07 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd" returned: 0 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:07 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c Apr 15 23:24:07 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:07 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-bcb90d57-462d-41c0-920b-6d44faa4dbc4" returned: 0 in 0.503s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-quobyte-bcb90d57-462d-41c0-920b-6d44faa4dbc4" released by "delete_volume" :: held 1.012s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Created reservations ['019cdefc-b1cd-4834-8ff9-66aef143f4c5', 'c0bd63bc-24bd-4c53-a3fd-6c964f19a632', '375b0c3b-3896-4994-a923-f5d7662b7c79', 'f8de5fec-8048-4068-808d-0ffd2f80e725'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:07 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:07 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:08 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c" returned: 0 in 1.158s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:08 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c Apr 15 23:24:08 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:08 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 1.126s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:08 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:08 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Deleted volume successfully. Apr 15 23:24:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c6413a93-6853-4598-aa04-e5efb88fc81c tempest-VolumesTransfersTest-1208265868 None] Lock "cinder-bcb90d57-462d-41c0-920b-6d44faa4dbc4-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:09 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img" returned: 0 in 2.552s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c362e-156a-4445-8e21-eedb7bf9bef2]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:09 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:24:09 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:09 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.336bcffb-59f3-44ae-b1fc-4a347ec56e2c" returned: 0 in 1.170s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-336bcffb-59f3-44ae-b1fc-4a347ec56e2c" released by "_delete_snapshot" :: held 3.363s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" released by "delete_snapshot" :: held 3.376s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Created reservations ['1a091db6-f164-40cc-9e82-2da7df4d85ba', 'd069cc39-6145-4fac-996e-e07b6b0e8a3a', '66e399c3-33bc-41d2-8143-84280ecb6486', '7dcfbc68-cbae-44a8-81f4-05aa9fab5514'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:09 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Delete snapshot completed successfully. Apr 15 23:24:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b0241ebc-efa8-4225-b7f1-84aa685c1759 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-336bcffb-59f3-44ae-b1fc-4a347ec56e2c-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:10 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.714s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a, size 1024.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:24:10 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Converted 1024.00 MB image at 401.03 MB/s Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] b352d797-85d6-4fb6-9a7a-b14cc1c62bab was raw, converting to qcow2 {{(pid=82388) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[338f4c30-fa8e-4ef3-b979-d88cddc4815e]: (4, 'raw') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:10 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img Apr 15 23:24:10 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-bffad3f8-47dd-48e6-b54b-4929e66d7cdd-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-bffad3f8-47dd-48e6-b54b-4929e66d7cdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-quobyte-bffad3f8-47dd-48e6-b54b-4929e66d7cdd" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-bffad3f8-47dd-48e6-b54b-4929e66d7cdd" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Deleting offline snapshot bffad3f8-47dd-48e6-b54b-4929e66d7cdd of volume c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] snapshot_file for this snap is: volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b24dd5a-0835-4440-8d52-f4f21de53d86]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:10 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd Apr 15 23:24:10 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:10 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img" returned: 0 in 0.540s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:10 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img Apr 15 23:24:10 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:11 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd" returned: 0 in 0.558s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef10be2-fdd1-41c9-b541-39f0da8a4bdb]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:11 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 Apr 15 23:24:11 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:11 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img" returned: 1 in 0.538s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img' failed. Not Retrying. {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img /opt/stack/data/cinder/conversion/vol_upload_moq5bl_q {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:11 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img /opt/stack/data/cinder/conversion/vol_upload_moq5bl_q Apr 15 23:24:11 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:11 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:11 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd Apr 15 23:24:11 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:11 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img /opt/stack/data/cinder/conversion/vol_upload_moq5bl_q" returned: 0 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Image conversion details: src /opt/stack/data/cinder/conversion/4fc48d03-5b53-45aa-b912-5defb3b4ed0a.temp_image.b352d797-85d6-4fb6-9a7a-b14cc1c62bab1cw5i1c6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_moq5bl_q {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:24:11 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfa007-c7bb-4ebe-8d01-202fd97a76e4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_moq5bl_q {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:11 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_moq5bl_q Apr 15 23:24:11 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:12 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd" returned: 0 in 0.543s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:12 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd Apr 15 23:24:12 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:12 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_moq5bl_q" returned: 0 in 0.532s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:12 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.bffad3f8-47dd-48e6-b54b-4929e66d7cdd" returned: 0 in 0.475s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-bffad3f8-47dd-48e6-b54b-4929e66d7cdd" released by "_delete_snapshot" :: held 2.155s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" released by "delete_snapshot" :: held 2.171s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Created reservations ['aec3ce22-bfde-4d94-a6ab-ce057c864f56', 'e323ab62-06d5-4196-bc4a-06bc0f6e7cc5', 'c668d60a-f2ce-4d03-bfa2-12b7eb39edb3', 'b4e0861d-b267-445b-86dc-d830f6ac3a3a'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Delete snapshot completed successfully. Apr 15 23:24:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a15de9e2-7bc6-499a-9c8a-e6c20add2bbf tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-bffad3f8-47dd-48e6-b54b-4929e66d7cdd-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Flow 'volume_create_manager' (8239afda-8d9f-41b3-a651-6a11c510ab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b7d3fb-1b61-4b77-82bc-c77ca2afeda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b7d3fb-1b61-4b77-82bc-c77ca2afeda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1378373851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f8e3bf-27e9-47c8-aa57-54c6aae53f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4b7e83c2fe4084b4dd4fe434a4918c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:13Z,use_quota=True,user_id='85a47c109dd64f46b26834b9df0108b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50237929-683a-435b-a916-0590c87c9b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50237929-683a-435b-a916-0590c87c9b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995056a1-1b67-45f1-a45c-448fdb6c6422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995056a1-1b67-45f1-a45c-448fdb6c6422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f8e3bf-27e9-47c8-aa57-54c6aae53f50', 'volume_name': 'volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b42f3-f6ac-4f11-ad83-eac056932ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b42f3-f6ac-4f11-ad83-eac056932ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a701858f-d740-4d42-9d1a-5995131fec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:13 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Volume 29f8e3bf-27e9-47c8-aa57-54c6aae53f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50', 'volume_size': 1} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.442s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Uploaded volume to glance image-id: b352d797-85d6-4fb6-9a7a-b14cc1c62bab. {{(pid=82388) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1378373851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f8e3bf-27e9-47c8-aa57-54c6aae53f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4b7e83c2fe4084b4dd4fe434a4918c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:13Z,use_quota=True,user_id='85a47c109dd64f46b26834b9df0108b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Creating volume 29f8e3bf-27e9-47c8-aa57-54c6aae53f50 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:13 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:13 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-209e8b00-f2dc-41f0-b090-52218183de4b tempest-VolumesActionsTest-991374586 None] Copy volume to image completed successfully. Apr 15 23:24:13 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 1073741824 Apr 15 23:24:13 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-7ba90132-2686-4770-b21b-c10c49991622-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-7ba90132-2686-4770-b21b-c10c49991622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-quobyte-7ba90132-2686-4770-b21b-c10c49991622" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-7ba90132-2686-4770-b21b-c10c49991622" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Deleting offline snapshot 7ba90132-2686-4770-b21b-c10c49991622 of volume c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] snapshot_file for this snap is: volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d2f3ab-5aa3-42eb-ade9-a6147d92e3b8]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:13 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 Apr 15 23:24:13 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:13 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 1073741824" returned: 0 in 0.482s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:13 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 Apr 15 23:24:13 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:14 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622" returned: 0 in 0.484s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb4c204-0fbc-437c-9d64-b640afe9006f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:14 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d Apr 15 23:24:14 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:14 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50" returned: 0 in 0.542s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a701858f-d740-4d42-9d1a-5995131fec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0888dff5-ba4b-4419-82a5-51f641410c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Volume volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 (29f8e3bf-27e9-47c8-aa57-54c6aae53f50): created successfully Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0888dff5-ba4b-4419-82a5-51f641410c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Flow 'volume_create_manager' (8239afda-8d9f-41b3-a651-6a11c510ab4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:14 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-07a59318-a33e-42a0-a7e5-d0697a70517d tempest-VolumesTransfersV355Test-1201178462 None] Created volume successfully. Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Acquiring lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Acquiring lock "cinder-quobyte-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Lock "cinder-quobyte-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0557c13-e67b-4900-81c2-07106d76617d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:14 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:24:14 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:14 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:14 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 Apr 15 23:24:14 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:14 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:14 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:14 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.467s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:14 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a Apr 15 23:24:14 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:15 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622" returned: 0 in 0.445s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:15 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622 Apr 15 23:24:15 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:15 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.446s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:15 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" returned: 0 in 0.460s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Lock "cinder-quobyte-4fc48d03-5b53-45aa-b912-5defb3b4ed0a" released by "delete_volume" :: held 0.947s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Created reservations ['7b9fa04d-6796-49cb-a5d1-b027f6dc03e0', '134f7ab2-c2df-461a-b1dd-7a22408de8ad', 'fdefbb2d-d029-4d95-ad96-335b415711f3', '5d5b9efc-6998-49e0-bfb7-c0f902d49730'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:15 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:15 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:15 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d.7ba90132-2686-4770-b21b-c10c49991622" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-7ba90132-2686-4770-b21b-c10c49991622" released by "_delete_snapshot" :: held 2.056s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" released by "delete_snapshot" :: held 2.074s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:15 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6bc4a254-2ca5-41c5-8fa1-821ad5cfaf0f tempest-VolumesTransfersV355Test-320495838 None] Transfer volume completed successfully. Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Created reservations ['5114954e-5712-4199-9a2c-f95242558f1c', '94119fd5-565a-42d0-81cd-190ecff42c44', 'e6ff6cce-693e-47c8-b7bc-8b64646fae4f', 'a6b3a9d1-ec61-4d07-ab41-91ad06c46847'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:15 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Delete snapshot completed successfully. Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fee414b2-ee54-406a-ad0b-21852c72e713 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-7ba90132-2686-4770-b21b-c10c49991622-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:15 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.454s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:15 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Deleted volume successfully. Apr 15 23:24:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-a8474d91-2621-489c-8417-bf1be6d0dd15 tempest-VolumesActionsTest-991374586 None] Lock "cinder-4fc48d03-5b53-45aa-b912-5defb3b4ed0a-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Acquiring lock "cinder-29f8e3bf-27e9-47c8-aa57-54c6aae53f50-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-29f8e3bf-27e9-47c8-aa57-54c6aae53f50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Acquiring lock "cinder-quobyte-29f8e3bf-27e9-47c8-aa57-54c6aae53f50" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-quobyte-29f8e3bf-27e9-47c8-aa57-54c6aae53f50" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c414c-06bf-4bd9-90f8-ca8b0aebe525]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:16 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 Apr 15 23:24:16 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-c30817c9-4c1a-4b1c-abf7-36d93d41717d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-c30817c9-4c1a-4b1c-abf7-36d93d41717d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[561a0c46-203f-48be-aee0-a89702d7d860]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:16 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d Apr 15 23:24:16 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:17 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50" returned: 0 in 0.478s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:17 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50 Apr 15 23:24:17 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:17 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d" returned: 0 in 0.540s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:17 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d Apr 15 23:24:17 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:17 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-29f8e3bf-27e9-47c8-aa57-54c6aae53f50" returned: 0 in 0.473s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-quobyte-29f8e3bf-27e9-47c8-aa57-54c6aae53f50" released by "delete_volume" :: held 0.987s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Created reservations ['5d944664-0b66-4ed2-8ebc-9cfd55a747e1', '9b86ddb7-1bf5-49d0-9823-adbe3446f1ec', '70b1283d-363f-4db4-b6a8-0f7de1b7614d', '31f8d7e0-08b4-4166-9535-d150c4efa036'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:17 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:17 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:17 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c30817c9-4c1a-4b1c-abf7-36d93d41717d" returned: 0 in 0.583s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-quobyte-c30817c9-4c1a-4b1c-abf7-36d93d41717d" released by "delete_volume" :: held 1.154s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Created reservations ['02927b16-921d-4bd6-a01e-a4cbcf15ba6c', 'c27fd274-7793-47ba-a73f-e400932ecd59', '284f6f03-33a9-4c57-b4bb-8a4f1b9662fa', '303c852a-50a8-4836-a33f-8a1a8c04f6ad'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Flow 'volume_create_manager' (c2692dcd-da9f-48dc-9076-ba186f4b64f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45716371-127a-40ca-9f34-c34eca91cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:18 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45716371-127a-40ca-9f34-c34eca91cef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-569051076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6933f4f3-a5e9-4c05-a78a-7bc377014c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4b7e83c2fe4084b4dd4fe434a4918c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:18Z,use_quota=True,user_id='85a47c109dd64f46b26834b9df0108b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ee420c-1fd3-4314-a6f0-1756ca54c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ee420c-1fd3-4314-a6f0-1756ca54c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bd8c27-2245-44b2-903e-99640ddf7f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bd8c27-2245-44b2-903e-99640ddf7f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6933f4f3-a5e9-4c05-a78a-7bc377014c7a', 'volume_name': 'volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b494a778-3861-4ee6-a6ea-04a60af62a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b494a778-3861-4ee6-a6ea-04a60af62a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc73e18-1f9e-42fe-beff-4c933f9d8c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:18 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Volume 6933f4f3-a5e9-4c05-a78a-7bc377014c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a', 'volume_size': 1} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-569051076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6933f4f3-a5e9-4c05-a78a-7bc377014c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4b7e83c2fe4084b4dd4fe434a4918c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:18Z,use_quota=True,user_id='85a47c109dd64f46b26834b9df0108b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Creating volume 6933f4f3-a5e9-4c05-a78a-7bc377014c7a {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:18 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:18 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a 1073741824 Apr 15 23:24:18 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.559s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Deleted volume successfully. Apr 15 23:24:18 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:18 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-112c56eb-32a1-40ed-916d-8184dcef4611 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-29f8e3bf-27e9-47c8-aa57-54c6aae53f50-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:18 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.506s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Deleted volume successfully. Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3f5de2a2-0385-4854-acc0-58f837bbaa15 tempest-VolumesSnapshotListTestJSON-1892188322 None] Lock "cinder-c30817c9-4c1a-4b1c-abf7-36d93d41717d-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:18 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a 1073741824" returned: 0 in 0.555s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:18 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a Apr 15 23:24:18 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:19 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a" returned: 0 in 0.439s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc73e18-1f9e-42fe-beff-4c933f9d8c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0557ebc7-751b-4c76-be08-e43434147050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:19 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Volume volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a (6933f4f3-a5e9-4c05-a78a-7bc377014c7a): created successfully Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0557ebc7-751b-4c76-be08-e43434147050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Flow 'volume_create_manager' (c2692dcd-da9f-48dc-9076-ba186f4b64f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cc09951e-1256-43bd-b232-8215c53c5cc1 tempest-VolumesTransfersV355Test-1201178462 None] Created volume successfully. Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Flow 'volume_create_manager' (3ef05fb4-973f-41f9-bf3f-6ef04e3cfa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bed418-702f-4694-b562-61f7b0445dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bed418-702f-4694-b562-61f7b0445dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1577004196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808aa3e-8270-4b4e-8ddb-8300abdb398d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4908805e937a452db3652854e8d2595e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:20Z,use_quota=True,user_id='a60daa03b73f4296a98cd293089ee1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d84699-f3f2-408c-b0ed-400aa443bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d84699-f3f2-408c-b0ed-400aa443bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6682068-1164-4e72-953a-8f79fc7800c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6682068-1164-4e72-953a-8f79fc7800c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3808aa3e-8270-4b4e-8ddb-8300abdb398d', 'volume_name': 'volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d', 'volume_size': 2}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dfae48-5cc3-4afa-9c8f-d364f2ea4e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dfae48-5cc3-4afa-9c8f-d364f2ea4e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553b4cee-c75a-4cb6-ae8c-e53eedf49e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:19 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Volume 3808aa3e-8270-4b4e-8ddb-8300abdb398d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d', 'volume_size': 2} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1577004196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808aa3e-8270-4b4e-8ddb-8300abdb398d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4908805e937a452db3652854e8d2595e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:20Z,use_quota=True,user_id='a60daa03b73f4296a98cd293089ee1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Creating volume 3808aa3e-8270-4b4e-8ddb-8300abdb398d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:19 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d 2147483648 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:19 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d 2147483648 Apr 15 23:24:19 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:20 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d 2147483648" returned: 0 in 0.595s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:20 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d Apr 15 23:24:20 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Acquiring lock "cinder-6933f4f3-a5e9-4c05-a78a-7bc377014c7a-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-6933f4f3-a5e9-4c05-a78a-7bc377014c7a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Acquiring lock "cinder-quobyte-6933f4f3-a5e9-4c05-a78a-7bc377014c7a" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-quobyte-6933f4f3-a5e9-4c05-a78a-7bc377014c7a" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a0c74f-9bbf-4e97-a598-3c6d56f80d96]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:20 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a Apr 15 23:24:20 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:20 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d" returned: 0 in 0.512s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553b4cee-c75a-4cb6-ae8c-e53eedf49e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d', 'volume_size': 2}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32deb2e0-6c27-4edd-99a8-d2409b33567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:20 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Volume volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d (3808aa3e-8270-4b4e-8ddb-8300abdb398d): created successfully Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32deb2e0-6c27-4edd-99a8-d2409b33567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Flow 'volume_create_manager' (3ef05fb4-973f-41f9-bf3f-6ef04e3cfa17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-54955698-21c3-454a-9bb8-500026f50428 tempest-VolumesCloneNegativeTest-29901225 None] Created volume successfully. Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (affc9e93-4981-4b34-9ace-edd5a197d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f62ffc-581f-4c5d-9ced-a9c0e64478cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f62ffc-581f-4c5d-9ced-a9c0e64478cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417079926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5fc072-b629-45a0-b8fb-a959369b791b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:21Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba79efb-bcd9-48b2-aedc-823a52c30035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba79efb-bcd9-48b2-aedc-823a52c30035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559abbf5-bda9-468f-be10-f54a65aecf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559abbf5-bda9-468f-be10-f54a65aecf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5fc072-b629-45a0-b8fb-a959369b791b', 'volume_name': 'volume-6f5fc072-b629-45a0-b8fb-a959369b791b', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9701c5ea-37e0-459e-8dec-8fc05db1a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9701c5ea-37e0-459e-8dec-8fc05db1a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e69fe86-5cf5-447a-8302-f2871c4d534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:20 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume 6f5fc072-b629-45a0-b8fb-a959369b791b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5fc072-b629-45a0-b8fb-a959369b791b', 'volume_size': 1} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417079926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5fc072-b629-45a0-b8fb-a959369b791b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:21Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Creating volume 6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:20 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:20 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b 1073741824 Apr 15 23:24:20 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:20 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a" returned: 0 in 0.531s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:21 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a Apr 15 23:24:21 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:21 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6933f4f3-a5e9-4c05-a78a-7bc377014c7a" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-quobyte-6933f4f3-a5e9-4c05-a78a-7bc377014c7a" released by "delete_volume" :: held 0.980s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:21 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b 1073741824" returned: 0 in 0.550s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Created reservations ['27834ad7-54e2-4293-a781-1a36bcc4408a', 'be04eb69-2b08-472f-87d4-57395b86a1ca', '9be18efd-0d9c-4a1e-9f6b-4895ac87a541', '27e097fb-fb77-4055-84e1-fb4caea67539'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:21 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b Apr 15 23:24:21 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:21 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:21 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Acquiring lock "cinder-3808aa3e-8270-4b4e-8ddb-8300abdb398d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Lock "cinder-3808aa3e-8270-4b4e-8ddb-8300abdb398d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Acquiring lock "cinder-quobyte-3808aa3e-8270-4b4e-8ddb-8300abdb398d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Lock "cinder-quobyte-3808aa3e-8270-4b4e-8ddb-8300abdb398d" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd240c66-93f4-4087-80af-c88539786e60]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:21 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d Apr 15 23:24:21 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:21 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e69fe86-5cf5-447a-8302-f2871c4d534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5fc072-b629-45a0-b8fb-a959369b791b', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a96f07-47dc-4779-8e6f-e59c1301cfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:21 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.457s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:21 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:22 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume volume-6f5fc072-b629-45a0-b8fb-a959369b791b (6f5fc072-b629-45a0-b8fb-a959369b791b): created successfully Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a96f07-47dc-4779-8e6f-e59c1301cfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (affc9e93-4981-4b34-9ace-edd5a197d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Deleted volume successfully. Apr 15 23:24:22 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ea3edad9-dfbe-4818-9513-dc8990e8eba5 tempest-CreateVolumesFromSnapshotTest-539886431 None] Created volume successfully. Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-86ca898b-393d-4de2-8293-ca4955e5b074 tempest-VolumesTransfersV355Test-426609713 None] Lock "cinder-6933f4f3-a5e9-4c05-a78a-7bc377014c7a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:22 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d" returned: 0 in 0.490s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:22 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d Apr 15 23:24:22 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:22 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3808aa3e-8270-4b4e-8ddb-8300abdb398d" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Lock "cinder-quobyte-3808aa3e-8270-4b4e-8ddb-8300abdb398d" released by "delete_volume" :: held 0.971s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Created reservations ['8cb250c8-b1eb-416d-86ff-19649d8b399e', '2783ab4d-e008-45e7-801b-c2486e1a3794', '656ed224-5b7c-495b-b3ef-8231c63a083c', 'fc825642-a2aa-425f-a57c-bfdd931df8e6'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:22 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:22 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Creating offline snapshot d675e477-e192-4404-a7ba-3cab96b5f980 of volume 6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c3e832-ed43-431f-a967-cda3a06f35fc]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:23 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b Apr 15 23:24:23 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:23 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.532s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:23 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Deleted volume successfully. Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-94795993-0538-4792-88b4-3eb5db8db153 tempest-VolumesCloneNegativeTest-29901225 None] Lock "cinder-3808aa3e-8270-4b4e-8ddb-8300abdb398d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:23 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b" returned: 0 in 0.735s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:23 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 1G Apr 15 23:24:23 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:24 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 1G" returned: 0 in 0.594s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5fc072-b629-45a0-b8fb-a959369b791b -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:24 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5fc072-b629-45a0-b8fb-a959369b791b -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 Apr 15 23:24:24 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:24 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5fc072-b629-45a0-b8fb-a959369b791b -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980" returned: 0 in 0.482s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:24 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 is being set with open permissions: ugo+rw Apr 15 23:24:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:25 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 Apr 15 23:24:25 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Flow 'volume_create_manager' (015e92ea-9cb8-4b79-a72d-85839bf340a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07809c46-dd62-417a-a93e-607ce3c054a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07809c46-dd62-417a-a93e-607ce3c054a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-836794876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a490d013-5908-4fcc-b705-7a1553a8ef7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='227d1e63c6a74c9a9ad21cf878117a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:25Z,use_quota=True,user_id='1878145b56cd487888bc755ac9c467ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056b4d74-0c26-463e-8bf2-6d7d82fb64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056b4d74-0c26-463e-8bf2-6d7d82fb64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b299386-af47-40a8-9421-0554e3a25deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b299386-af47-40a8-9421-0554e3a25deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a490d013-5908-4fcc-b705-7a1553a8ef7f', 'volume_name': 'volume-a490d013-5908-4fcc-b705-7a1553a8ef7f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d32ce42-729e-493a-ac84-23366f5c5d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d32ce42-729e-493a-ac84-23366f5c5d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf881cf-12ac-41b6-b961-bda919b74a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:25 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Volume a490d013-5908-4fcc-b705-7a1553a8ef7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a490d013-5908-4fcc-b705-7a1553a8ef7f', 'volume_size': 1} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:25 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980" returned: 0 in 0.514s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:25 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.info Apr 15 23:24:25 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:25 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.info" returned: 0 in 0.465s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:25 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.info is being set with open permissions: ugo+rw Apr 15 23:24:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:26 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.info Apr 15 23:24:26 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:26 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.info" returned: 0 in 0.462s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.316s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-836794876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a490d013-5908-4fcc-b705-7a1553a8ef7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='227d1e63c6a74c9a9ad21cf878117a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:25Z,use_quota=True,user_id='1878145b56cd487888bc755ac9c467ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Creating volume a490d013-5908-4fcc-b705-7a1553a8ef7f {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:26 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:26 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f 1073741824 Apr 15 23:24:26 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-aa7f1382-5564-4f18-82e2-83caca76e67f tempest-CreateVolumesFromSnapshotTest-539886431 None] Create snapshot completed successfully Apr 15 23:24:27 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f 1073741824" returned: 0 in 0.549s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:27 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f Apr 15 23:24:27 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Flow 'volume_create_manager' (bce9c9cc-3bd8-4e4a-a992-922c2c5358c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88519992-a2fd-40cb-a8e0-951e7105c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88519992-a2fd-40cb-a8e0-951e7105c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1914284242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde2a459-e78d-440b-88a2-9ed925badbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655465b603724a57b643eb083395d089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:27Z,use_quota=True,user_id='3d8ccf25ff544b26b3420dda3b5a370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fb221d-5ede-4339-b063-4fbac133629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fb221d-5ede-4339-b063-4fbac133629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cb37e3-95d4-48a9-baea-345f7bffad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cb37e3-95d4-48a9-baea-345f7bffad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fde2a459-e78d-440b-88a2-9ed925badbad', 'volume_name': 'volume-fde2a459-e78d-440b-88a2-9ed925badbad', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b25b7c-3d79-45c9-86f9-6419403273ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b25b7c-3d79-45c9-86f9-6419403273ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d54fcec-c829-4cb5-b755-66d664b8ccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Volume fde2a459-e78d-440b-88a2-9ed925badbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fde2a459-e78d-440b-88a2-9ed925badbad', 'volume_size': 1} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:27 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f" returned: 0 in 0.478s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.284s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1914284242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde2a459-e78d-440b-88a2-9ed925badbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655465b603724a57b643eb083395d089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:27Z,use_quota=True,user_id='3d8ccf25ff544b26b3420dda3b5a370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Creating volume fde2a459-e78d-440b-88a2-9ed925badbad {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:27 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf881cf-12ac-41b6-b961-bda919b74a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a490d013-5908-4fcc-b705-7a1553a8ef7f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a45d9c-5685-4b60-a9d4-d482b25b606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad 1073741824 Apr 15 23:24:27 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Volume volume-a490d013-5908-4fcc-b705-7a1553a8ef7f (a490d013-5908-4fcc-b705-7a1553a8ef7f): created successfully Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a45d9c-5685-4b60-a9d4-d482b25b606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Flow 'volume_create_manager' (015e92ea-9cb8-4b79-a72d-85839bf340a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3698c7b1-280b-4c49-bf30-8d1a4d5f57f0 tempest-VolumesListTestJSON-868431667 None] Created volume successfully. Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (24a6daed-41ef-4219-b86d-11e3a82a77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cc4b0e-9209-4ae3-9da9-7a7402c5766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cc4b0e-9209-4ae3-9da9-7a7402c5766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1786741225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d862100-e9be-4882-8ce4-a9f1628e3a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dee011e-55f4-4439-b28f-29caf6e97736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dee011e-55f4-4439-b28f-29caf6e97736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f03babb-66e9-4372-9294-f154bbd42140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f03babb-66e9-4372-9294-f154bbd42140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d862100-e9be-4882-8ce4-a9f1628e3a06', 'volume_name': 'volume-0d862100-e9be-4882-8ce4-a9f1628e3a06', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c669a5e3-1b2c-4db7-bb51-c6694fceb9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c669a5e3-1b2c-4db7-bb51-c6694fceb9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b7525b-c11e-4aa9-9a0e-a97cee724b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume 0d862100-e9be-4882-8ce4-a9f1628e3a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d862100-e9be-4882-8ce4-a9f1628e3a06', 'volume_size': 1} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (007ccfe1-14f2-4c61-9c5e-f9d513708f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc3cc4-7717-4221-a2a5-db91699cd9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc3cc4-7717-4221-a2a5-db91699cd9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880918086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be93793a-22ec-4d0a-99c9-09fd56d3b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc26e43-8b7f-4630-b0ae-4ec38568fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc26e43-8b7f-4630-b0ae-4ec38568fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd168a1-ac4c-46e9-95d6-1dc147bc2434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd168a1-ac4c-46e9-95d6-1dc147bc2434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be93793a-22ec-4d0a-99c9-09fd56d3b77e', 'volume_name': 'volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a201210e-536a-431e-8e91-f8675805ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a201210e-536a-431e-8e91-f8675805ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13986eef-08ac-4019-a777-767dce027dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume be93793a-22ec-4d0a-99c9-09fd56d3b77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e', 'volume_size': 1} Apr 15 23:24:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (76445435-a397-48ed-9670-3172bb2629a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71029086-4d8c-4ba3-a0af-ec2dbdc3a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71029086-4d8c-4ba3-a0af-ec2dbdc3a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398027410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8f00a6-1a26-420e-ad15-2a42887d6bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3adf092-e7db-448d-a908-58981017f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3adf092-e7db-448d-a908-58981017f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d9d9fc-dd24-41ff-a834-33c67e8e6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d9d9fc-dd24-41ff-a834-33c67e8e6d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8f00a6-1a26-420e-ad15-2a42887d6bd9', 'volume_name': 'volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010fa069-048a-4ba0-bd03-4856e413ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010fa069-048a-4ba0-bd03-4856e413ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a9e9fa-af2e-4cf3-880d-29eedf766e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume 6b8f00a6-1a26-420e-ad15-2a42887d6bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9', 'volume_size': 1} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:28 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad 1073741824" returned: 0 in 0.609s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:28 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad Apr 15 23:24:28 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (e578c95d-556e-4679-8d2c-d34286600067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab58d54d-6ed5-41ae-9821-668f405b6a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab58d54d-6ed5-41ae-9821-668f405b6a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246908104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0929ba-2b72-43b7-a531-78e67e1f392f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babd2cad-98ea-4be5-b281-1ea27a2ccea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babd2cad-98ea-4be5-b281-1ea27a2ccea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1761855f-819d-4ad7-a81d-d15cfbcad4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1761855f-819d-4ad7-a81d-d15cfbcad4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0929ba-2b72-43b7-a531-78e67e1f392f', 'volume_name': 'volume-1a0929ba-2b72-43b7-a531-78e67e1f392f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8897c86-0969-43cf-8578-3dfe01e0b3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8897c86-0969-43cf-8578-3dfe01e0b3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81ad60b-b950-4d7b-b8d8-71c4a92ca733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume 1a0929ba-2b72-43b7-a531-78e67e1f392f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0929ba-2b72-43b7-a531-78e67e1f392f', 'volume_size': 1} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (bec736e6-497a-45e6-9dc5-afa87fc7a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4684ac1-ca0d-439d-b24d-5e4f53a6c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4684ac1-ca0d-439d-b24d-5e4f53a6c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1997842979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334ba6f4-0eb7-423b-aafe-26e13220356d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5e65df-fbf1-4f21-9fc4-237ca0e4c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5e65df-fbf1-4f21-9fc4-237ca0e4c33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13415ead-2502-4aab-b9f8-3eab6a9a536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13415ead-2502-4aab-b9f8-3eab6a9a536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334ba6f4-0eb7-423b-aafe-26e13220356d', 'volume_name': 'volume-334ba6f4-0eb7-423b-aafe-26e13220356d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172649d2-81d5-4248-8178-165eb7862b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172649d2-81d5-4248-8178-165eb7862b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1c874b-7589-4df9-ae4b-d11470a902eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume 334ba6f4-0eb7-423b-aafe-26e13220356d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334ba6f4-0eb7-423b-aafe-26e13220356d', 'volume_size': 1} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:28 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Flow 'volume_create_manager' (295359ca-f0cc-4a90-8eb2-f66b7b111c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98cf2c3-5b56-4f93-b9ba-b8b7a119d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98cf2c3-5b56-4f93-b9ba-b8b7a119d22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971979391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d30f23-1c78-45a6-b392-11cf05701935,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='227d1e63c6a74c9a9ad21cf878117a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:29Z,use_quota=True,user_id='1878145b56cd487888bc755ac9c467ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9e0b1f-2f14-4044-9629-8f37d4f02d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9e0b1f-2f14-4044-9629-8f37d4f02d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c867e49-9f87-4030-9d2c-01398ed9765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c867e49-9f87-4030-9d2c-01398ed9765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d30f23-1c78-45a6-b392-11cf05701935', 'volume_name': 'volume-a9d30f23-1c78-45a6-b392-11cf05701935', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790947d1-a609-483c-b0de-234bb386611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790947d1-a609-483c-b0de-234bb386611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1013b33e-fd74-42a6-bf68-1c3c7e464cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Volume a9d30f23-1c78-45a6-b392-11cf05701935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d30f23-1c78-45a6-b392-11cf05701935', 'volume_size': 1} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad" returned: 0 in 0.560s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1786741225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d862100-e9be-4882-8ce4-a9f1628e3a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Creating volume 0d862100-e9be-4882-8ce4-a9f1628e3a06 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:28 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d54fcec-c829-4cb5-b755-66d664b8ccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fde2a459-e78d-440b-88a2-9ed925badbad', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 1073741824 Apr 15 23:24:28 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf5d99a-5e35-4f3d-acdf-0f3139218e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:28 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Volume volume-fde2a459-e78d-440b-88a2-9ed925badbad (fde2a459-e78d-440b-88a2-9ed925badbad): created successfully Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf5d99a-5e35-4f3d-acdf-0f3139218e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:28 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Flow 'volume_create_manager' (bce9c9cc-3bd8-4e4a-a992-922c2c5358c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dfdaa0e1-d288-40e2-99ea-569d7bec9472 tempest-VolumesTransfersV357Test-751415224 None] Created volume successfully. Apr 15 23:24:29 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 1073741824" returned: 0 in 0.447s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:29 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 Apr 15 23:24:29 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-804762c3-a002-4541-939d-0596a36889b4 tempest-VolumesTransfersV357Test-264155100 None] Transfer volume completed successfully. Apr 15 23:24:29 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06" returned: 0 in 0.485s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880918086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be93793a-22ec-4d0a-99c9-09fd56d3b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Creating volume be93793a-22ec-4d0a-99c9-09fd56d3b77e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:29 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:29 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e 1073741824 Apr 15 23:24:29 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b7525b-c11e-4aa9-9a0e-a97cee724b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d862100-e9be-4882-8ce4-a9f1628e3a06', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44775ba-b672-497e-a6b4-fa0f34ba67e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:29 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 (0d862100-e9be-4882-8ce4-a9f1628e3a06): created successfully Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44775ba-b672-497e-a6b4-fa0f34ba67e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (24a6daed-41ef-4219-b86d-11e3a82a77b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-713b5317-e684-420c-ae84-90dc76581b3f tempest-CreateVolumesFromSnapshotTest-539886431 None] Created volume successfully. Apr 15 23:24:30 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e 1073741824" returned: 0 in 0.460s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:30 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e Apr 15 23:24:30 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Acquiring lock "cinder-fde2a459-e78d-440b-88a2-9ed925badbad-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-fde2a459-e78d-440b-88a2-9ed925badbad-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Acquiring lock "cinder-quobyte-fde2a459-e78d-440b-88a2-9ed925badbad" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-quobyte-fde2a459-e78d-440b-88a2-9ed925badbad" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a15c9-ab79-41d0-b40f-c2317a8c1927]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:30 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad Apr 15 23:24:30 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:30 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e" returned: 0 in 0.445s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.557s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398027410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8f00a6-1a26-420e-ad15-2a42887d6bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Creating volume 6b8f00a6-1a26-420e-ad15-2a42887d6bd9 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:30 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:30 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 1073741824 Apr 15 23:24:30 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13986eef-08ac-4019-a777-767dce027dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31ca600-556a-4e24-993a-4e07e262fc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:30 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e (be93793a-22ec-4d0a-99c9-09fd56d3b77e): created successfully Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31ca600-556a-4e24-993a-4e07e262fc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (007ccfe1-14f2-4c61-9c5e-f9d513708f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:30 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-36e32b73-bab6-4c64-9e6c-cf01e1a66492 tempest-CreateVolumesFromSnapshotTest-539886431 None] Created volume successfully. Apr 15 23:24:30 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad" returned: 0 in 0.478s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:30 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad Apr 15 23:24:30 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:31 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 1073741824" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:31 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 Apr 15 23:24:31 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:31 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-fde2a459-e78d-440b-88a2-9ed925badbad" returned: 0 in 0.414s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-quobyte-fde2a459-e78d-440b-88a2-9ed925badbad" released by "delete_volume" :: held 0.921s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Created reservations ['0b488e39-1e56-4f99-b8b7-f198d47bc7df', 'f7f0f28a-a87b-4711-a0d6-d8692ae6f0b8', '580e4e7a-8fc3-4930-917e-55f2c8da0598', '50c3d839-dd87-42a4-b4fb-da34b14d704d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:31 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:31 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:31 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9" returned: 0 in 0.415s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.239s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246908104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0929ba-2b72-43b7-a531-78e67e1f392f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Creating volume 1a0929ba-2b72-43b7-a531-78e67e1f392f {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:31 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a9e9fa-af2e-4cf3-880d-29eedf766e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749bb0d4-1a33-4f41-a195-2cafeef767b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:31 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 (6b8f00a6-1a26-420e-ad15-2a42887d6bd9): created successfully Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749bb0d4-1a33-4f41-a195-2cafeef767b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (76445435-a397-48ed-9670-3172bb2629a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:31 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f 1073741824 Apr 15 23:24:31 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7fe47798-adce-4bab-a184-50ed4d0ef60d tempest-CreateVolumesFromSnapshotTest-539886431 None] Created volume successfully. Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Flow 'volume_create_manager' (bd7dbd9b-ee48-43d0-aabb-a28c901cc0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815f0492-f470-40bf-82b9-81de8145aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:31 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815f0492-f470-40bf-82b9-81de8145aac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1874120209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c477e977-5d1c-4a60-b4a9-7cd112186059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655465b603724a57b643eb083395d089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:32Z,use_quota=True,user_id='3d8ccf25ff544b26b3420dda3b5a370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2bedac-f234-4417-a098-0c2cd1f20feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2bedac-f234-4417-a098-0c2cd1f20feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a0d87-216a-4870-ac53-a7615b468862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a0d87-216a-4870-ac53-a7615b468862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c477e977-5d1c-4a60-b4a9-7cd112186059', 'volume_name': 'volume-c477e977-5d1c-4a60-b4a9-7cd112186059', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca4eeb2-db72-42de-af58-f571f65fa206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca4eeb2-db72-42de-af58-f571f65fa206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c781646b-da13-4446-b31d-a95b1c04b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:31 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Volume c477e977-5d1c-4a60-b4a9-7cd112186059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c477e977-5d1c-4a60-b4a9-7cd112186059', 'volume_size': 1} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.458s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Deleted volume successfully. Apr 15 23:24:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-253bebe4-e25e-4902-a119-16024eeb71d3 tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-fde2a459-e78d-440b-88a2-9ed925badbad-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:32 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f 1073741824" returned: 0 in 0.556s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:32 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f Apr 15 23:24:32 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:32 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f" returned: 0 in 0.391s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.031s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1997842979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334ba6f4-0eb7-423b-aafe-26e13220356d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116aa5474dbe4b569970b15e400d76c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:28Z,use_quota=True,user_id='19901a20591f4d6abba70a917727572e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Creating volume 334ba6f4-0eb7-423b-aafe-26e13220356d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:32 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81ad60b-b950-4d7b-b8d8-71c4a92ca733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0929ba-2b72-43b7-a531-78e67e1f392f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:32 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d 1073741824 Apr 15 23:24:32 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe5c290-4573-4bbb-b15e-cb6d9bf58f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:32 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume volume-1a0929ba-2b72-43b7-a531-78e67e1f392f (1a0929ba-2b72-43b7-a531-78e67e1f392f): created successfully Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe5c290-4573-4bbb-b15e-cb6d9bf58f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (e578c95d-556e-4679-8d2c-d34286600067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:32 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f1221bd7-3683-4db7-ab72-961e76e1c5e2 tempest-CreateVolumesFromSnapshotTest-539886431 None] Created volume successfully. Apr 15 23:24:32 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d 1073741824" returned: 0 in 0.459s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:33 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d Apr 15 23:24:33 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:33 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d" returned: 0 in 0.392s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.678s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971979391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d30f23-1c78-45a6-b392-11cf05701935,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='227d1e63c6a74c9a9ad21cf878117a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:29Z,use_quota=True,user_id='1878145b56cd487888bc755ac9c467ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Creating volume a9d30f23-1c78-45a6-b392-11cf05701935 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:33 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1c874b-7589-4df9-ae4b-d11470a902eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334ba6f4-0eb7-423b-aafe-26e13220356d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f503e0d5-1144-4583-8b4c-f5cf3567f029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:33 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 1073741824 Apr 15 23:24:33 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:33 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Volume volume-334ba6f4-0eb7-423b-aafe-26e13220356d (334ba6f4-0eb7-423b-aafe-26e13220356d): created successfully Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f503e0d5-1144-4583-8b4c-f5cf3567f029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Flow 'volume_create_manager' (bec736e6-497a-45e6-9dc5-afa87fc7a45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-40226321-8fd0-4813-b182-2676554bc0e9 tempest-CreateVolumesFromSnapshotTest-539886431 None] Created volume successfully. Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-334ba6f4-0eb7-423b-aafe-26e13220356d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-334ba6f4-0eb7-423b-aafe-26e13220356d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-334ba6f4-0eb7-423b-aafe-26e13220356d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:33 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 1073741824" returned: 0 in 0.519s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-334ba6f4-0eb7-423b-aafe-26e13220356d" acquired by "delete_volume" :: waited 0.020s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c25751c-7819-4373-80c7-589d1a2f827f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:33 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 Apr 15 23:24:33 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:34 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d Apr 15 23:24:34 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:34 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d" returned: 0 in 0.442s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:34 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d Apr 15 23:24:34 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:34 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935" returned: 0 in 0.442s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.523s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1874120209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c477e977-5d1c-4a60-b4a9-7cd112186059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655465b603724a57b643eb083395d089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:32Z,use_quota=True,user_id='3d8ccf25ff544b26b3420dda3b5a370b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Creating volume c477e977-5d1c-4a60-b4a9-7cd112186059 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:34 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1013b33e-fd74-42a6-bf68-1c3c7e464cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d30f23-1c78-45a6-b392-11cf05701935', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdad52c6-f031-447f-8cf2-2020aa432341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:34 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 1073741824 Apr 15 23:24:34 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:34 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Volume volume-a9d30f23-1c78-45a6-b392-11cf05701935 (a9d30f23-1c78-45a6-b392-11cf05701935): created successfully Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdad52c6-f031-447f-8cf2-2020aa432341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Flow 'volume_create_manager' (295359ca-f0cc-4a90-8eb2-f66b7b111c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:34 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-52e18f4e-9971-4696-ae98-206470023c65 tempest-VolumesListTestJSON-868431667 None] Created volume successfully. Apr 15 23:24:34 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-334ba6f4-0eb7-423b-aafe-26e13220356d" returned: 0 in 0.387s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-334ba6f4-0eb7-423b-aafe-26e13220356d" released by "delete_volume" :: held 0.858s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Created reservations ['69c48961-2b6e-44f1-bb14-d33bc1482172', 'fca21be5-0e97-4c83-b974-e222f01164c4', '53ff9729-b6cc-446d-98ea-d9cc73cfa526', '67521ec6-ade5-4d15-816f-70bace6af2dc'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:34 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:34 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:34 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 1073741824" returned: 0 in 0.526s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:35 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 Apr 15 23:24:35 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-1a0929ba-2b72-43b7-a531-78e67e1f392f-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-1a0929ba-2b72-43b7-a531-78e67e1f392f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-1a0929ba-2b72-43b7-a531-78e67e1f392f" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-1a0929ba-2b72-43b7-a531-78e67e1f392f" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7356e471-a536-46c1-a453-d481e13f70c1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:35 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f Apr 15 23:24:35 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Flow 'volume_create_manager' (d40c1d6f-6cd4-43b8-9606-3275c0e17735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6cf2f8-e67c-4660-8882-ea0f4deb32dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:35 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6cf2f8-e67c-4660-8882-ea0f4deb32dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1335375556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7ea21-07d4-4f63-8a65-22763a03bc9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='227d1e63c6a74c9a9ad21cf878117a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:35Z,use_quota=True,user_id='1878145b56cd487888bc755ac9c467ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49db23c9-914f-4b9f-a743-70fdd39bb298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49db23c9-914f-4b9f-a743-70fdd39bb298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e26333e-5b62-4416-bab5-2401143ddf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e26333e-5b62-4416-bab5-2401143ddf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e7ea21-07d4-4f63-8a65-22763a03bc9d', 'volume_name': 'volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cab402-fd76-4473-b7a9-bd7311f3e185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cab402-fd76-4473-b7a9-bd7311f3e185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62023b9-1116-4228-8b12-01033aa1c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:35 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Volume 05e7ea21-07d4-4f63-8a65-22763a03bc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d', 'volume_size': 1} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:35 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Deleted volume successfully. Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9897939f-682e-4edd-8ea3-60d070323b2f tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-334ba6f4-0eb7-423b-aafe-26e13220356d-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:35 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059" returned: 0 in 0.514s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1335375556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7ea21-07d4-4f63-8a65-22763a03bc9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='227d1e63c6a74c9a9ad21cf878117a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:35Z,use_quota=True,user_id='1878145b56cd487888bc755ac9c467ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Creating volume 05e7ea21-07d4-4f63-8a65-22763a03bc9d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:35 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c781646b-da13-4446-b31d-a95b1c04b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c477e977-5d1c-4a60-b4a9-7cd112186059', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:35 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d 1073741824 Apr 15 23:24:35 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19c7ae-8167-45b5-a069-983d1549674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:35 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Volume volume-c477e977-5d1c-4a60-b4a9-7cd112186059 (c477e977-5d1c-4a60-b4a9-7cd112186059): created successfully Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19c7ae-8167-45b5-a069-983d1549674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Flow 'volume_create_manager' (bd7dbd9b-ee48-43d0-aabb-a28c901cc0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:35 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fa94ce1c-2e07-45d6-9d24-a9e72dc0cdb7 tempest-VolumesTransfersV357Test-751415224 None] Created volume successfully. Apr 15 23:24:35 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f" returned: 0 in 0.553s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:35 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f Apr 15 23:24:35 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:35 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d 1073741824" returned: 0 in 0.476s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:36 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d Apr 15 23:24:36 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:36 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1a0929ba-2b72-43b7-a531-78e67e1f392f" returned: 0 in 0.476s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-1a0929ba-2b72-43b7-a531-78e67e1f392f" released by "delete_volume" :: held 1.063s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Created reservations ['52c093d4-eb3c-4a54-b445-65f743042632', '2f126e7c-9a36-43c7-9121-604b33f29f00', 'aa1a0172-5863-4edf-b551-f9ecb70a7019', '93e7005f-6221-4e51-b090-57ce5151579d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:36 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:36 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Acquiring lock "cinder-c477e977-5d1c-4a60-b4a9-7cd112186059-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-c477e977-5d1c-4a60-b4a9-7cd112186059-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Acquiring lock "cinder-quobyte-c477e977-5d1c-4a60-b4a9-7cd112186059" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-quobyte-c477e977-5d1c-4a60-b4a9-7cd112186059" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d355b25-e705-474f-8771-251dba7bd70f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:36 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d" returned: 0 in 0.431s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62023b9-1116-4228-8b12-01033aa1c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:36 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 Apr 15 23:24:36 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b573afe6-9d66-42e2-b07b-0c4ff180c52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:36 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Volume volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d (05e7ea21-07d4-4f63-8a65-22763a03bc9d): created successfully Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b573afe6-9d66-42e2-b07b-0c4ff180c52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Flow 'volume_create_manager' (d40c1d6f-6cd4-43b8-9606-3275c0e17735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-52375d4b-7922-4287-aa8c-a60067ab8142 tempest-VolumesListTestJSON-868431667 None] Created volume successfully. Apr 15 23:24:36 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:36 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Deleted volume successfully. Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b754faae-3518-40a7-b41c-73ec7269adeb tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-1a0929ba-2b72-43b7-a531-78e67e1f392f-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:36 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059" returned: 0 in 0.448s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:36 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059 Apr 15 23:24:36 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-6b8f00a6-1a26-420e-ad15-2a42887d6bd9-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:37 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-6b8f00a6-1a26-420e-ad15-2a42887d6bd9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-c477e977-5d1c-4a60-b4a9-7cd112186059" returned: 0 in 0.401s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-quobyte-c477e977-5d1c-4a60-b4a9-7cd112186059" released by "delete_volume" :: held 0.887s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-6b8f00a6-1a26-420e-ad15-2a42887d6bd9" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-6b8f00a6-1a26-420e-ad15-2a42887d6bd9" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[54133b29-73c0-4916-ad64-0618d7fc06d2]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Created reservations ['7d7804ad-bdb3-47a3-b108-bb98fa97ccb8', '33d9d802-6754-4801-a507-8562c72a9ab7', '953bbbc9-5aec-4537-a7c3-b88afb930b09', 'fc157cc6-f1b1-43fa-b88c-df9c78fd03e7'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:37 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 Apr 15 23:24:37 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:37 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:37 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:37 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.503s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:37 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Deleted volume successfully. Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1f59bbba-9f70-42ac-95e1-a3652935036b tempest-VolumesTransfersV357Test-2003034188 None] Lock "cinder-c477e977-5d1c-4a60-b4a9-7cd112186059-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:37 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9" returned: 0 in 0.622s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:37 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9 Apr 15 23:24:37 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:38 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b8f00a6-1a26-420e-ad15-2a42887d6bd9" returned: 0 in 0.548s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-6b8f00a6-1a26-420e-ad15-2a42887d6bd9" released by "delete_volume" :: held 1.195s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Created reservations ['0ce3b3c9-b3c6-4ce8-a627-5fe1aade32ae', '9946103f-889c-444d-82ad-1a996bfbebf8', 'a04418ce-b02a-4285-90cf-a0af3f41af0c', '84345ad6-859b-430f-bf67-f2299789f46e'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:38 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:38 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:39 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:39 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Deleted volume successfully. Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1141f776-8e3c-49e2-8eb9-7ca85a09c1f1 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-6b8f00a6-1a26-420e-ad15-2a42887d6bd9-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-be93793a-22ec-4d0a-99c9-09fd56d3b77e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-be93793a-22ec-4d0a-99c9-09fd56d3b77e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-be93793a-22ec-4d0a-99c9-09fd56d3b77e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-be93793a-22ec-4d0a-99c9-09fd56d3b77e" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d197a00-15ae-44ad-ada5-fa36d75a881f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:39 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e Apr 15 23:24:39 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Acquiring lock "cinder-05e7ea21-07d4-4f63-8a65-22763a03bc9d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Lock "cinder-05e7ea21-07d4-4f63-8a65-22763a03bc9d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Acquiring lock "cinder-quobyte-05e7ea21-07d4-4f63-8a65-22763a03bc9d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Lock "cinder-quobyte-05e7ea21-07d4-4f63-8a65-22763a03bc9d" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a27a4d-5b5f-459c-8d26-47d8959cdff1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:39 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d Apr 15 23:24:39 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:40 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e" returned: 0 in 0.658s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:40 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e Apr 15 23:24:40 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:40 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d" returned: 0 in 0.523s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:40 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d Apr 15 23:24:40 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:40 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-be93793a-22ec-4d0a-99c9-09fd56d3b77e" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-be93793a-22ec-4d0a-99c9-09fd56d3b77e" released by "delete_volume" :: held 1.165s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Created reservations ['b7afa759-8d34-43eb-934b-11e88f6c0a16', '6c38d842-c2f4-4b60-ac27-182b7f3dfa2a', '7eecf1e0-b548-40c7-bdeb-193b2a39f3d6', '98ff4816-9747-4fab-95ec-996f99a21e9b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:40 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:40 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:40 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-05e7ea21-07d4-4f63-8a65-22763a03bc9d" returned: 0 in 0.411s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Lock "cinder-quobyte-05e7ea21-07d4-4f63-8a65-22763a03bc9d" released by "delete_volume" :: held 0.964s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Created reservations ['292a0844-1624-4e77-9bb7-06bf8cbb1791', '2644cea5-5f9e-4708-8282-0b0ba4f121d3', '4d5314b9-136e-4981-824d-42579a998908', '279d849b-abb1-45a2-8a53-aa2e0d971107'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:40 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:40 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Acquiring lock "cinder-a9d30f23-1c78-45a6-b392-11cf05701935-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Lock "cinder-a9d30f23-1c78-45a6-b392-11cf05701935-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Acquiring lock "cinder-quobyte-a9d30f23-1c78-45a6-b392-11cf05701935" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Flow 'volume_create_manager' (bc8c0db9-2ab5-43d8-ba63-bccb7abbf87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20c0524-fa8d-4174-802f-b51af6dbaa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Lock "cinder-quobyte-a9d30f23-1c78-45a6-b392-11cf05701935" acquired by "delete_volume" :: waited 0.040s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20c0524-fa8d-4174-802f-b51af6dbaa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-631469679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fbad6b243a1464a952e9c125086a76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:41Z,use_quota=True,user_id='e1ae97309569466c84985da92762794a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3850658-1494-4f24-954b-c0af675535e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3850658-1494-4f24-954b-c0af675535e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f239dbe3-7d15-4edd-a93a-4e39c5402f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f239dbe3-7d15-4edd-a93a-4e39c5402f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504', 'volume_name': 'volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca2f058-fb6f-4f1e-9c72-fa6a2ee9703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca2f058-fb6f-4f1e-9c72-fa6a2ee9703e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9845f22-8840-4110-9639-9bb448a016ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:41 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Volume 9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504', 'volume_size': 1} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-631469679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fbad6b243a1464a952e9c125086a76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:41Z,use_quota=True,user_id='e1ae97309569466c84985da92762794a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Creating volume 9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:41 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[286bb1d7-4b0b-4c4f-96bb-f11ee11bff79]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:41 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 1073741824 Apr 15 23:24:41 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:41 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.453s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:41 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Deleted volume successfully. Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-14baafa8-ab48-485a-925c-6a2c15fdb3ea tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-be93793a-22ec-4d0a-99c9-09fd56d3b77e-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:41 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 Apr 15 23:24:41 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:41 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:41 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Deleted volume successfully. Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-45bb949a-bdca-40c6-b24a-949f99f97dfb tempest-VolumesListTestJSON-868431667 None] Lock "cinder-05e7ea21-07d4-4f63-8a65-22763a03bc9d-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-0d862100-e9be-4882-8ce4-a9f1628e3a06-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-0d862100-e9be-4882-8ce4-a9f1628e3a06-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:41 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 1073741824" returned: 0 in 0.494s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-0d862100-e9be-4882-8ce4-a9f1628e3a06" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-0d862100-e9be-4882-8ce4-a9f1628e3a06" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:41 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 Apr 15 23:24:41 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dde0a2-016a-4202-bd54-ced6a0b77574]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:41 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935" returned: 0 in 0.549s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:41 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935 Apr 15 23:24:41 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:41 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 Apr 15 23:24:41 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:42 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a9d30f23-1c78-45a6-b392-11cf05701935" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Lock "cinder-quobyte-a9d30f23-1c78-45a6-b392-11cf05701935" released by "delete_volume" :: held 1.055s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:42 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9845f22-8840-4110-9639-9bb448a016ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf149cf9-0889-41ee-bdd9-fe9e730db62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:42 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06" returned: 0 in 0.490s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:42 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06 Apr 15 23:24:42 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:42 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Volume volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 (9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504): created successfully Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf149cf9-0889-41ee-bdd9-fe9e730db62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Flow 'volume_create_manager' (bc8c0db9-2ab5-43d8-ba63-bccb7abbf87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:42 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ded7711b-8499-4e9b-be96-185223e87e75 tempest-VolumesCloneTest-967917380 None] Created volume successfully. Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Created reservations ['3bca1adf-cbc9-4af7-b744-ea24db9781a5', 'c9cf8d09-2185-45b9-805d-db91eb0149b4', 'ebc8611f-df45-4e44-96ad-5389d6790a0b', 'ffabba05-df0f-4304-9713-54a64220de31'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:42 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:42 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:42 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0d862100-e9be-4882-8ce4-a9f1628e3a06" returned: 0 in 0.403s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-0d862100-e9be-4882-8ce4-a9f1628e3a06" released by "delete_volume" :: held 0.915s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=151,cinder:UPDATE=175,cinder:INSERT=47,cinder:DELETE=17 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Created reservations ['f775713d-32e1-4cfe-a0fc-548685fc7587', '5133428f-eef1-4aa1-90a3-c0d1630feebc', '3316ecaf-cf7a-41f6-a7ab-7b9ef355bb9b', '188e5f91-76e1-4d37-962b-fb0075b921b3'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:42 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:42 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:42 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.428s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:42 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Deleted volume successfully. Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-6645d474-6e0d-44c6-ab05-b19e6b3195bf tempest-VolumesListTestJSON-868431667 None] Lock "cinder-a9d30f23-1c78-45a6-b392-11cf05701935-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-d675e477-e192-4404-a7ba-3cab96b5f980-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-d675e477-e192-4404-a7ba-3cab96b5f980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-6f5fc072-b629-45a0-b8fb-a959369b791b" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-6f5fc072-b629-45a0-b8fb-a959369b791b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-d675e477-e192-4404-a7ba-3cab96b5f980" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-d675e477-e192-4404-a7ba-3cab96b5f980" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Deleting offline snapshot d675e477-e192-4404-a7ba-3cab96b5f980 of volume 6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] snapshot_file for this snap is: volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a146d8-0146-4d09-8e77-ee83e85fd8bf]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:42 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 Apr 15 23:24:42 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:43 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.397s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:43 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Deleted volume successfully. Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-974eb59e-5abc-40ca-9002-f13e3a06bf04 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-0d862100-e9be-4882-8ce4-a9f1628e3a06-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Acquiring lock "cinder-a490d013-5908-4fcc-b705-7a1553a8ef7f-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Lock "cinder-a490d013-5908-4fcc-b705-7a1553a8ef7f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Acquiring lock "cinder-quobyte-a490d013-5908-4fcc-b705-7a1553a8ef7f" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Lock "cinder-quobyte-a490d013-5908-4fcc-b705-7a1553a8ef7f" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4a61a8-13ec-4ae6-b6e7-d67b253e541e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:43 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980" returned: 0 in 0.529s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f5fc072-b629-45a0-b8fb-a959369b791b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2916446-164a-4ff2-9a6a-c5b662ebb0e8]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:43 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f Apr 15 23:24:43 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:43 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b Apr 15 23:24:43 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Flow 'volume_create_manager' (2d99c5b4-6d96-4cce-978b-5556e95d4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09407588-f290-410e-bbdc-9d9628efde2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09407588-f290-410e-bbdc-9d9628efde2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1475125227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f57448f-2062-4afd-821a-d7bdb7f50667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fbad6b243a1464a952e9c125086a76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:43Z,use_quota=True,user_id='e1ae97309569466c84985da92762794a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3ecc60-f8a8-4b25-a46b-a0feb1d16b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3ecc60-f8a8-4b25-a46b-a0feb1d16b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ce2fd5-6300-442d-a9af-55f5f34a2b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ce2fd5-6300-442d-a9af-55f5f34a2b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9f57448f-2062-4afd-821a-d7bdb7f50667', 'volume_name': 'volume-9f57448f-2062-4afd-821a-d7bdb7f50667', 'volume_size': 2, 'source_volid': '9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfaaca51-88d7-4d66-9afd-08820d5aa16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfaaca51-88d7-4d66-9afd-08820d5aa16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793fc244-7388-44f2-97e6-7aa8a0296b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:43 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Volume 9f57448f-2062-4afd-821a-d7bdb7f50667: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9f57448f-2062-4afd-821a-d7bdb7f50667', 'volume_size': 2, 'source_volid': '9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504', 'source_volstatus': 'available'} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:43 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Cloning volume 9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 to volume 9f57448f-2062-4afd-821a-d7bdb7f50667 Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Creating offline snapshot ff214d33-ad26-4335-a596-f3f635444eb0 of volume 9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d267b2-398a-449a-9013-e4f384a45841]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:43 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 Apr 15 23:24:43 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:43 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f" returned: 0 in 0.537s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:43 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f Apr 15 23:24:43 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:43 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b" returned: 0 in 0.526s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:43 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 Apr 15 23:24:43 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:44 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:44 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 1G Apr 15 23:24:44 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:44 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a490d013-5908-4fcc-b705-7a1553a8ef7f" returned: 0 in 0.446s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Lock "cinder-quobyte-a490d013-5908-4fcc-b705-7a1553a8ef7f" released by "delete_volume" :: held 1.013s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Created reservations ['91f2f4b3-46c8-4751-976d-006f071a896e', '363f3d3c-9e48-4ef5-881a-02b5b8fead5e', '8c080782-116f-4c64-bb37-79390d37826e', '74cc7a2a-dd0f-4bc1-95d2-2de915c1f45b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:44 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980" returned: 0 in 0.486s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:44 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980 Apr 15 23:24:44 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:44 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:44 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:44 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 1G" returned: 0 in 0.537s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:44 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 Apr 15 23:24:44 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:44 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b.d675e477-e192-4404-a7ba-3cab96b5f980" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:44 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.449s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Deleted volume successfully. Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-d675e477-e192-4404-a7ba-3cab96b5f980" released by "_delete_snapshot" :: held 2.053s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-6f5fc072-b629-45a0-b8fb-a959369b791b" released by "delete_snapshot" :: held 2.072s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b45e7fdb-4ae2-4574-8318-bafdf5c4954e tempest-VolumesListTestJSON-868431667 None] Lock "cinder-a490d013-5908-4fcc-b705-7a1553a8ef7f-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Created reservations ['6757cb85-0e27-45db-afcc-9955a20f684d', 'f6875ba7-db92-44fd-ad43-8283fdba969c', '7ef67301-4abb-4e05-acf1-c0211ef59689', '9f77f7b6-db33-4e04-ba23-f4c8b69a43e4'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Delete snapshot completed successfully. Apr 15 23:24:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-05fec263-1a79-41ba-b85c-f9a3c571fe7d tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-d675e477-e192-4404-a7ba-3cab96b5f980-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:45 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:45 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 is being set with open permissions: ugo+rw Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:45 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 Apr 15 23:24:45 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:45 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0" returned: 0 in 0.457s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:45 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.info Apr 15 23:24:45 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-6f5fc072-b629-45a0-b8fb-a959369b791b-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-6f5fc072-b629-45a0-b8fb-a959369b791b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "cinder-quobyte-6f5fc072-b629-45a0-b8fb-a959369b791b" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-6f5fc072-b629-45a0-b8fb-a959369b791b" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f3271c-8694-456a-bef0-9d8e317a9235]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:45 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.info" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:45 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.info is being set with open permissions: ugo+rw Apr 15 23:24:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:45 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.info Apr 15 23:24:45 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:45 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b Apr 15 23:24:45 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:46 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:46 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b" returned: 0 in 0.528s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.info" returned: 0 in 0.494s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Acquiring lock "cinder-quobyte-9f57448f-2062-4afd-821a-d7bdb7f50667" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:46 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b Apr 15 23:24:46 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-9f57448f-2062-4afd-821a-d7bdb7f50667" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] snapshot: ff214d33-ad26-4335-a596-f3f635444eb0, volume: 9f57448f-2062-4afd-821a-d7bdb7f50667, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[94918b62-2a07-4bc5-8abf-967f95304cfa]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:46 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 Apr 15 23:24:46 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:46 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6f5fc072-b629-45a0-b8fb-a959369b791b" returned: 0 in 0.462s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-quobyte-6f5fc072-b629-45a0-b8fb-a959369b791b" released by "delete_volume" :: held 1.026s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:46 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Created reservations ['fc42db1e-5ec2-4cd7-9969-1861fc7a3831', 'c54727c5-f7cd-40c4-80c9-72c88f3832eb', 'b7ec562e-589c-4e34-a703-dab8cb03067f', '527bc909-91ae-47c5-837c-db2a3bb92e6d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:47 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0" returned: 0 in 0.554s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:24:47 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e207469-3d29-4876-8475-f453a4820f92]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:47 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (7071ef95-c856-4722-a113-08feca72d427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574187ef-9354-4442-b8e4-42b1782a8825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574187ef-9354-4442-b8e4-42b1782a8825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1405618388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8e8c1f-dabf-403f-b9ed-c42f241503af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62569b1df30c418098b477615786d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:47Z,use_quota=True,user_id='27ae79f9841b4e4e8f8502925c09a60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8ce9a2-e60e-4442-b8c5-21fc67ab98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8ce9a2-e60e-4442-b8c5-21fc67ab98f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de68758-dcb0-4215-b563-0dcfeeb97d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de68758-dcb0-4215-b563-0dcfeeb97d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8e8c1f-dabf-403f-b9ed-c42f241503af', 'volume_name': 'volume-af8e8c1f-dabf-403f-b9ed-c42f241503af', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c48179-4afa-477b-87ca-d3dfa1960c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c48179-4afa-477b-87ca-d3dfa1960c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bf39eb-50c7-4161-9b28-e86b80fd2418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:47 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 Apr 15 23:24:47 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Volume af8e8c1f-dabf-403f-b9ed-c42f241503af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8e8c1f-dabf-403f-b9ed-c42f241503af', 'volume_size': 1} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:47 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:47 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.414s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:47 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Deleted volume successfully. Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1d657d74-fbc3-4505-a3b7-f3d35ae8aa25 tempest-CreateVolumesFromSnapshotTest-539886431 None] Lock "cinder-6f5fc072-b629-45a0-b8fb-a959369b791b-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:47 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:24:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:47 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 Apr 15 23:24:47 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:49 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667" returned: 0 in 2.081s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d855986-7963-4278-8a2f-1fc1e9d8fc0a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:49 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 Apr 15 23:24:49 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:50 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" returned: 0 in 0.671s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:24:50 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Converted 1024.00 MB image at 491.78 MB/s Apr 15 23:24:50 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 is being set with open permissions: ugo+rw Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:50 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 Apr 15 23:24:50 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (c156e659-be18-4a5c-91ac-0877dd52bb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22117a5f-5a3a-41a0-a218-7b9df63010df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22117a5f-5a3a-41a0-a218-7b9df63010df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-487041628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b649f86-5e3b-4a44-970f-9ab4587552c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:51Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5441bc1-79b5-4af2-a58f-0d6aa34590e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5441bc1-79b5-4af2-a58f-0d6aa34590e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3405edf2-e27a-4366-acb3-d4aac11cd94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3405edf2-e27a-4366-acb3-d4aac11cd94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b649f86-5e3b-4a44-970f-9ab4587552c5', 'volume_name': 'volume-6b649f86-5e3b-4a44-970f-9ab4587552c5', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae92ba33-4eeb-401b-8400-cd9a0a6053cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae92ba33-4eeb-401b-8400-cd9a0a6053cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1979ad-b580-496e-a1f1-4cee8caf3d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:50 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume 6b649f86-5e3b-4a44-970f-9ab4587552c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b649f86-5e3b-4a44-970f-9ab4587552c5', 'volume_size': 1} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:50 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667" returned: 0 in 0.437s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-9f57448f-2062-4afd-821a-d7bdb7f50667" released by "_copy_volume_from_snapshot" :: held 4.274s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Acquiring lock "cinder-quobyte-ff214d33-ad26-4335-a596-f3f635444eb0" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-ff214d33-ad26-4335-a596-f3f635444eb0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Deleting offline snapshot ff214d33-ad26-4335-a596-f3f635444eb0 of volume 9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] snapshot_file for this snap is: volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a2a23-3fa6-4a4c-8eb4-1767fbca0251]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:50 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 Apr 15 23:24:50 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:51 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:24:51 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e2de3-200b-4bda-8aa0-58f128272f31]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:51 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 Apr 15 23:24:51 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:51 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:51 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 Apr 15 23:24:51 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:52 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0" returned: 0 in 0.478s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:52 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0 Apr 15 23:24:52 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:52 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504.ff214d33-ad26-4335-a596-f3f635444eb0" returned: 0 in 0.399s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-ff214d33-ad26-4335-a596-f3f635444eb0" released by "_delete_snapshot" :: held 1.854s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.116s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.515s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1405618388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8e8c1f-dabf-403f-b9ed-c42f241503af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62569b1df30c418098b477615786d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:47Z,use_quota=True,user_id='27ae79f9841b4e4e8f8502925c09a60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Creating volume af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:52 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793fc244-7388-44f2-97e6-7aa8a0296b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f57448f-2062-4afd-821a-d7bdb7f50667', 'volume_size': 2, 'source_volid': '9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:52 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af 1073741824 Apr 15 23:24:52 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb633ce4-d6bf-47f6-883c-74f81a3c2e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:52 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Volume volume-9f57448f-2062-4afd-821a-d7bdb7f50667 (9f57448f-2062-4afd-821a-d7bdb7f50667): created successfully Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb633ce4-d6bf-47f6-883c-74f81a3c2e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Flow 'volume_create_manager' (2d99c5b4-6d96-4cce-978b-5556e95d4e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:52 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ff09062f-fcde-40cd-b198-00ffc7d077d8 tempest-VolumesCloneTest-967917380 None] Created volume successfully. Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Acquiring lock "cinder-9f57448f-2062-4afd-821a-d7bdb7f50667-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Lock "cinder-9f57448f-2062-4afd-821a-d7bdb7f50667-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Acquiring lock "cinder-quobyte-9f57448f-2062-4afd-821a-d7bdb7f50667" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-9f57448f-2062-4afd-821a-d7bdb7f50667" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0339b2-6f78-4a6b-93eb-71f5e3126bb8]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:53 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 Apr 15 23:24:53 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:53 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af 1073741824" returned: 0 in 0.521s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:53 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af Apr 15 23:24:53 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:53 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667" returned: 0 in 0.489s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:53 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667 Apr 15 23:24:53 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:53 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af" returned: 0 in 0.428s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.886s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-487041628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b649f86-5e3b-4a44-970f-9ab4587552c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:51Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Creating volume 6b649f86-5e3b-4a44-970f-9ab4587552c5 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:53 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bf39eb-50c7-4161-9b28-e86b80fd2418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8e8c1f-dabf-403f-b9ed-c42f241503af', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96813026-cca2-4698-ac4b-791a23640ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:53 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 1073741824 Apr 15 23:24:53 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:53 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Volume volume-af8e8c1f-dabf-403f-b9ed-c42f241503af (af8e8c1f-dabf-403f-b9ed-c42f241503af): created successfully Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96813026-cca2-4698-ac4b-791a23640ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (7071ef95-c856-4722-a113-08feca72d427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:53 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e40bb3f7-0546-46c4-bf0c-f30776b4b3df tempest-VolumeDependencyTests-1741778541 None] Created volume successfully. Apr 15 23:24:53 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9f57448f-2062-4afd-821a-d7bdb7f50667" returned: 0 in 0.432s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-9f57448f-2062-4afd-821a-d7bdb7f50667" released by "delete_volume" :: held 0.942s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:53 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:INSERT=53,cinder:UPDATE=254,cinder:SELECT=159,cinder:DELETE=20 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Created reservations ['844cd0b4-d73a-453b-bb40-af1bd7cbb061', '16da6add-dfaf-4ee9-92f0-995b189178d6', '477b0e6c-7aad-4112-8a7c-bc121f91f0bb', '13ca81e2-c2cc-4bb2-a1d5-b18d1263d193'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:54 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:54 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Acquiring lock "cinder-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Lock "cinder-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:54 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 1073741824" returned: 0 in 0.569s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Acquiring lock "cinder-quobyte-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:24:54 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 Apr 15 23:24:54 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3799fb2-cf41-4d02-af53-22439df037bc]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:54 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 Apr 15 23:24:54 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:54 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.486s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Deleted volume successfully. Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c980962-38d1-482b-a58e-bedbc66a1519 tempest-VolumesCloneTest-967917380 None] Lock "cinder-9f57448f-2062-4afd-821a-d7bdb7f50667-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:54 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Creating offline snapshot e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc of volume af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1979ad-b580-496e-a1f1-4cee8caf3d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b649f86-5e3b-4a44-970f-9ab4587552c5', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073662d-f32a-4661-8f37-0e6fc20ffd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7751e9a3-3e9b-4814-8130-4b73bae4c437]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:54 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 (6b649f86-5e3b-4a44-970f-9ab4587552c5): created successfully Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073662d-f32a-4661-8f37-0e6fc20ffd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (c156e659-be18-4a5c-91ac-0877dd52bb1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:54 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5f494d74-0324-49ee-b164-901276379b82 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created volume successfully. Apr 15 23:24:54 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af Apr 15 23:24:54 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:54 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" returned: 0 in 0.538s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:54 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504 Apr 15 23:24:54 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (e93e999f-428a-471e-aa20-abeb61a6ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f007a87-c8af-46b7-9b19-79691ef8ed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f007a87-c8af-46b7-9b19-79691ef8ed5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311794602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafe8e64-9b73-488f-ac9b-e1ef6213b693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae27f8e-c83a-48d5-9f10-b669736266aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae27f8e-c83a-48d5-9f10-b669736266aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f9095-e475-4e2a-a380-03a5dd51fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f9095-e475-4e2a-a380-03a5dd51fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafe8e64-9b73-488f-ac9b-e1ef6213b693', 'volume_name': 'volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70fb3dc-dba4-4df0-a330-fac8f2bc8a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70fb3dc-dba4-4df0-a330-fac8f2bc8a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea8b9fa-1e7f-4b00-8f56-a2e836c33091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume aafe8e64-9b73-488f-ac9b-e1ef6213b693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693', 'volume_size': 1} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:55 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af" returned: 0 in 0.538s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:55 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc 1G Apr 15 23:24:55 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (b0f1a640-8fc3-4976-8eca-9ec9ece0ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d82f67-90fe-4cc3-9bbe-b20f63e50c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" returned: 0 in 0.499s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d82f67-90fe-4cc3-9bbe-b20f63e50c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-745147409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619775f3-7961-44a0-b26b-92254c2da3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da27ba98-4198-4061-9ed1-eaf615f8e8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da27ba98-4198-4061-9ed1-eaf615f8e8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af2267c-82c5-4426-adb9-3c2f44e3791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af2267c-82c5-4426-adb9-3c2f44e3791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619775f3-7961-44a0-b26b-92254c2da3f4', 'volume_name': 'volume-619775f3-7961-44a0-b26b-92254c2da3f4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0001967f-94a1-4284-b4c6-3e6e06e3a4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0001967f-94a1-4284-b4c6-3e6e06e3a4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909caff2-5782-42f3-9726-0f8c2a6eedb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume 619775f3-7961-44a0-b26b-92254c2da3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619775f3-7961-44a0-b26b-92254c2da3f4', 'volume_size': 1} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Lock "cinder-quobyte-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504" released by "delete_volume" :: held 1.103s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Created reservations ['cacf8c0a-3d38-4ce0-a68e-e864ed795191', '6781c476-114d-47ce-af8a-42ac4ab58c55', 'e2cf5c3c-33b8-45ed-8ac6-c1a819396b6b', '4612f707-3168-4f52-8745-95db54cd05b6'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:55 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:24:55 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (c8621c2b-ebfa-47b2-972c-aac9314e105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5036731-f7fe-4039-9324-d89c00678b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5036731-f7fe-4039-9324-d89c00678b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033583777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bc1152-1100-4809-ad27-d15190a06b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1dc075-f859-43da-bbe6-9fedc82e570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1dc075-f859-43da-bbe6-9fedc82e570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3877f57-0d26-416f-908c-8a62287389bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3877f57-0d26-416f-908c-8a62287389bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54bc1152-1100-4809-ad27-d15190a06b2c', 'volume_name': 'volume-54bc1152-1100-4809-ad27-d15190a06b2c', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cf7e1e-d6db-4152-bb44-bcc1adc8fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cf7e1e-d6db-4152-bb44-bcc1adc8fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3985e21-a510-458e-9e18-85fb589f3eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume 54bc1152-1100-4809-ad27-d15190a06b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54bc1152-1100-4809-ad27-d15190a06b2c', 'volume_size': 1} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (ad2ca56d-14bd-488d-9683-9a508ff048ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe428d8-f407-4e4c-9586-a40d913a410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe428d8-f407-4e4c-9586-a40d913a410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855444518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ba54b2-a99c-442b-8918-8cbfbcae5572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:56Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6162e34-557f-4cd4-89ee-ae88e0f314d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6162e34-557f-4cd4-89ee-ae88e0f314d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bc6012-6935-4f02-8c80-47bbc6d66693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bc6012-6935-4f02-8c80-47bbc6d66693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ba54b2-a99c-442b-8918-8cbfbcae5572', 'volume_name': 'volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acaf32c-1ab8-4692-8030-3d496dc1634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acaf32c-1ab8-4692-8030-3d496dc1634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedb0981-2b6b-4c86-83d0-1e78e5be0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume f6ba54b2-a99c-442b-8918-8cbfbcae5572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572', 'volume_size': 1} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:55 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc 1G" returned: 0 in 0.593s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8e8c1f-dabf-403f-b9ed-c42f241503af -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:55 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8e8c1f-dabf-403f-b9ed-c42f241503af -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc Apr 15 23:24:55 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (ffa0b966-60f5-4655-a08e-dae09790cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a388c852-72b2-49b5-ba11-a58c0e941141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.531s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a388c852-72b2-49b5-ba11-a58c0e941141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858904373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dab7e75-fd52-45c7-b3e4-29ece4b761d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:56Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd36f81-3b5c-4133-9df6-e5d5827d4df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd36f81-3b5c-4133-9df6-e5d5827d4df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327bc17a-08ec-4780-9828-bbdacdbc32ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327bc17a-08ec-4780-9828-bbdacdbc32ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dab7e75-fd52-45c7-b3e4-29ece4b761d7', 'volume_name': 'volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b0d0c3-0a81-4820-8c72-1dec34acf7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:55 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b0d0c3-0a81-4820-8c72-1dec34acf7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9782e4-2ca9-4bad-8174-c505ed57979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:56 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume 3dab7e75-fd52-45c7-b3e4-29ece4b761d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7', 'volume_size': 1} Apr 15 23:24:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:56 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Deleted volume successfully. Apr 15 23:24:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ae90ed0-3449-48fe-ac5a-7ce57556c03a tempest-VolumesCloneTest-967917380 None] Lock "cinder-9ae8fcaf-93b4-44d7-9eeb-b0b09e99c504-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:24:56 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8e8c1f-dabf-403f-b9ed-c42f241503af -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:56 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc is being set with open permissions: ugo+rw Apr 15 23:24:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:56 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc Apr 15 23:24:56 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:56 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" returned: 0 in 0.407s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:56 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.info Apr 15 23:24:56 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:57 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.info" returned: 0 in 0.464s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:57 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.info is being set with open permissions: ugo+rw Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:57 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.info Apr 15 23:24:57 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:57 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.info" returned: 0 in 0.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.913s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.408s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1311794602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafe8e64-9b73-488f-ac9b-e1ef6213b693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Creating volume aafe8e64-9b73-488f-ac9b-e1ef6213b693 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:57 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:57 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8444c1f7-14b3-43be-848b-850ae2edb06c tempest-VolumeDependencyTests-1741778541 None] Create snapshot completed successfully Apr 15 23:24:57 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 1073741824 Apr 15 23:24:57 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:57 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (ec8fec5c-c514-4881-a0b6-e6a91c1d88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4b64b4-0007-4f6e-a181-32d5ab2a756b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4b64b4-0007-4f6e-a181-32d5ab2a756b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-438693586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6464b2f-1b2e-4c26-babd-77a02695cfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62569b1df30c418098b477615786d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:58Z,use_quota=True,user_id='27ae79f9841b4e4e8f8502925c09a60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89edd6c9-2036-4428-8436-c25ec276182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89edd6c9-2036-4428-8436-c25ec276182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5752ad71-1d7f-4793-be26-6596dd75c507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5752ad71-1d7f-4793-be26-6596dd75c507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6464b2f-1b2e-4c26-babd-77a02695cfb0', 'volume_name': 'volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0', 'volume_size': 1, 'snapshot_id': 'e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a30488-b575-483c-8c99-4e6424c1be22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a30488-b575-483c-8c99-4e6424c1be22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6885c69-7443-42b9-9ab2-417364421afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:58 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Volume a6464b2f-1b2e-4c26-babd-77a02695cfb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0', 'volume_size': 1, 'snapshot_id': 'e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc'} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:58 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 1073741824" returned: 0 in 0.569s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:58 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 Apr 15 23:24:58 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:58 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.307s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-745147409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619775f3-7961-44a0-b26b-92254c2da3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Creating volume 619775f3-7961-44a0-b26b-92254c2da3f4 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:58 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea8b9fa-1e7f-4b00-8f56-a2e836c33091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50f8167-423e-478f-92ea-d5b4f1842250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:58 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 1073741824 Apr 15 23:24:58 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:58 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 (aafe8e64-9b73-488f-ac9b-e1ef6213b693): created successfully Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50f8167-423e-478f-92ea-d5b4f1842250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:58 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (e93e999f-428a-471e-aa20-abeb61a6ab58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:58 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c50f4841-05b9-46a1-8338-3c879b9fd17a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created volume successfully. Apr 15 23:24:59 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 1073741824" returned: 0 in 0.507s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:59 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 Apr 15 23:24:59 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Flow 'volume_create_manager' (14a69968-3344-4399-984a-ef8a79cc354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080b6986-9857-4edf-96ba-838e37e50895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080b6986-9857-4edf-96ba-838e37e50895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1957897654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de45cc32-52f7-4f49-8b5a-be0f318ea360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76bc8d0c256242b382f7aa6613f6de9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:00Z,use_quota=True,user_id='4ad0f32ba19040828d5a3b7fe2bfe9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cc0d4a-3895-4ff0-af20-c2ff03a23d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:59 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cc0d4a-3895-4ff0-af20-c2ff03a23d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a00dddb-6a63-489c-9f92-cd3b5b112d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a00dddb-6a63-489c-9f92-cd3b5b112d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de45cc32-52f7-4f49-8b5a-be0f318ea360', 'volume_name': 'volume-de45cc32-52f7-4f49-8b5a-be0f318ea360', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3cccd0-8801-48b3-b879-db58ad32223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3cccd0-8801-48b3-b879-db58ad32223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48683fbe-6ebd-4126-9f80-0b8f2fc4f1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:59 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Volume de45cc32-52f7-4f49-8b5a-be0f318ea360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de45cc32-52f7-4f49-8b5a-be0f318ea360', 'volume_size': 1} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4" returned: 0 in 0.467s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.080s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033583777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bc1152-1100-4809-ad27-d15190a06b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:55Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Creating volume 54bc1152-1100-4809-ad27-d15190a06b2c {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:24:59 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909caff2-5782-42f3-9726-0f8c2a6eedb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619775f3-7961-44a0-b26b-92254c2da3f4', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e95d34-fbb6-4e9c-8c3e-bfa790b4f502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:24:59 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c 1073741824 Apr 15 23:24:59 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:24:59 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume volume-619775f3-7961-44a0-b26b-92254c2da3f4 (619775f3-7961-44a0-b26b-92254c2da3f4): created successfully Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e95d34-fbb6-4e9c-8c3e-bfa790b4f502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:24:59 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (b0f1a640-8fc3-4976-8eca-9ec9ece0ef78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:24:59 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1f1b5bb2-d6fd-44f7-a038-9415f1c55197 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created volume successfully. Apr 15 23:25:00 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c 1073741824" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:00 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c Apr 15 23:25:00 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:00 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c" returned: 0 in 0.404s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.788s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855444518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ba54b2-a99c-442b-8918-8cbfbcae5572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:56Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Creating volume f6ba54b2-a99c-442b-8918-8cbfbcae5572 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:00 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3985e21-a510-458e-9e18-85fb589f3eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bc1152-1100-4809-ad27-d15190a06b2c', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47e8300-f465-4e2e-bb96-d5b17d5080db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:00 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 1073741824 Apr 15 23:25:00 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:00 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume volume-54bc1152-1100-4809-ad27-d15190a06b2c (54bc1152-1100-4809-ad27-d15190a06b2c): created successfully Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47e8300-f465-4e2e-bb96-d5b17d5080db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:00 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (c8621c2b-ebfa-47b2-972c-aac9314e105a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5ecca414-87eb-4aae-9fde-b0f74e592846 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created volume successfully. Apr 15 23:25:01 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 1073741824" returned: 0 in 0.469s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:01 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 Apr 15 23:25:01 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:01 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572" returned: 0 in 0.409s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.473s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858904373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dab7e75-fd52-45c7-b3e4-29ece4b761d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7410623e83a48b5be99f297b2444595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:24:56Z,use_quota=True,user_id='ee53890ad37148a4a6acaf1266aba346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Creating volume 3dab7e75-fd52-45c7-b3e4-29ece4b761d7 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:01 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedb0981-2b6b-4c86-83d0-1e78e5be0beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:01 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 1073741824 Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81a267a-4a55-4fcc-ba23-6d3ec5b34681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:01 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:01 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 (f6ba54b2-a99c-442b-8918-8cbfbcae5572): created successfully Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81a267a-4a55-4fcc-ba23-6d3ec5b34681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (ad2ca56d-14bd-488d-9683-9a508ff048ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-544cad82-4f5c-40f0-b949-006ed0c892b2 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created volume successfully. Apr 15 23:25:01 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 1073741824" returned: 0 in 0.458s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:01 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 Apr 15 23:25:01 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:02 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7" returned: 0 in 0.394s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.290s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc-a6464b2f-1b2e-4c26-babd-77a02695cfb0" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9782e4-2ca9-4bad-8174-c505ed57979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef75b1bf-2bb2-4fb1-a5de-1339515eb628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc-a6464b2f-1b2e-4c26-babd-77a02695cfb0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Creating volume a6464b2f-1b2e-4c26-babd-77a02695cfb0 from snapshot e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-a6464b2f-1b2e-4c26-babd-77a02695cfb0" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:02 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Volume volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 (3dab7e75-fd52-45c7-b3e4-29ece4b761d7): created successfully Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef75b1bf-2bb2-4fb1-a5de-1339515eb628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Flow 'volume_create_manager' (ffa0b966-60f5-4655-a08e-dae09790cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-a6464b2f-1b2e-4c26-babd-77a02695cfb0" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] snapshot: e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc, volume: a6464b2f-1b2e-4c26-babd-77a02695cfb0, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:02 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-624e65de-8062-4ca1-8c58-3233cc13530e tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created volume successfully. Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc8091e-0c62-43cb-829a-60191c3fd88d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-3dab7e75-fd52-45c7-b3e4-29ece4b761d7-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-3dab7e75-fd52-45c7-b3e4-29ece4b761d7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:02 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc Apr 15 23:25:02 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-quobyte-3dab7e75-fd52-45c7-b3e4-29ece4b761d7" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-3dab7e75-fd52-45c7-b3e4-29ece4b761d7" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0062b65-9d5c-4d02-95c0-b2b76f9dcc21]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:02 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 Apr 15 23:25:02 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:02 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" returned: 0 in 0.473s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af8e8c1f-dabf-403f-b9ed-c42f241503af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b896656-8e44-45c2-bd98-4b74dd217482]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:03 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af Apr 15 23:25:03 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:03 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7" returned: 0 in 0.485s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:03 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7 Apr 15 23:25:03 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:03 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af" returned: 0 in 0.458s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:03 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 Apr 15 23:25:03 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:03 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3dab7e75-fd52-45c7-b3e4-29ece4b761d7" returned: 0 in 0.425s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-3dab7e75-fd52-45c7-b3e4-29ece4b761d7" released by "delete_volume" :: held 0.933s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created reservations ['7e7f56d6-f62c-4173-bf0b-972c1f1521f5', 'd0f8fc96-54e9-47f4-891c-e16179e5b594', 'f8d0ca8a-3fba-4d24-ab3a-fe85dd7af1a4', '0cfc0c64-8f84-4ee2-ae34-3cb054e4dbf8'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:03 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:03 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-f6ba54b2-a99c-442b-8918-8cbfbcae5572-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-f6ba54b2-a99c-442b-8918-8cbfbcae5572-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-quobyte-f6ba54b2-a99c-442b-8918-8cbfbcae5572" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-f6ba54b2-a99c-442b-8918-8cbfbcae5572" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c9eea4-9643-4401-b68a-e097855634c7]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:03 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 Apr 15 23:25:03 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:04 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.929s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:04 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:04 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Deleted volume successfully. Apr 15 23:25:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d4d8b551-a7cc-486c-acbe-0606192f95a9 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-3dab7e75-fd52-45c7-b3e4-29ece4b761d7-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:04 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572" returned: 0 in 1.177s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:04 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572 Apr 15 23:25:04 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:05 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0" returned: 0 in 2.234s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff408aef-72b0-4bc5-b401-c7fe7c7aa928]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:05 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af Apr 15 23:25:05 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:05 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6ba54b2-a99c-442b-8918-8cbfbcae5572" returned: 0 in 0.890s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-f6ba54b2-a99c-442b-8918-8cbfbcae5572" released by "delete_volume" :: held 2.090s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created reservations ['ef6aa672-e100-4379-afce-911716128075', 'e3aca223-2d09-4a12-adb0-5456548262a1', 'b1ff53ea-d239-48f9-9e05-46078d04f01d', '547e0f4e-1006-45b8-8b4b-17fd6918014a'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:05 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:05 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-54bc1152-1100-4809-ad27-d15190a06b2c-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-54bc1152-1100-4809-ad27-d15190a06b2c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-quobyte-54bc1152-1100-4809-ad27-d15190a06b2c" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-54bc1152-1100-4809-ad27-d15190a06b2c" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[90db4c08-7659-472d-a4ce-6b4b6e8aa1fe]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:06 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c Apr 15 23:25:06 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:06 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.408s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:06 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Deleted volume successfully. Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e3f918c6-97ed-4d06-bffe-fd2f233c4bc5 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-f6ba54b2-a99c-442b-8918-8cbfbcae5572-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:06 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af" returned: 0 in 0.677s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:25:06 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Converted 1024.00 MB image at 458.20 MB/s Apr 15 23:25:06 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 is being set with open permissions: ugo+rw Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:06 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 Apr 15 23:25:06 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:06 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c" returned: 0 in 0.463s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:06 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c Apr 15 23:25:06 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:06 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0" returned: 0 in 0.431s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-a6464b2f-1b2e-4c26-babd-77a02695cfb0" released by "_copy_volume_from_snapshot" :: held 4.336s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc-a6464b2f-1b2e-4c26-babd-77a02695cfb0" released by "_create_volume_from_snapshot" :: held 4.387s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.407s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.130s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1957897654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de45cc32-52f7-4f49-8b5a-be0f318ea360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76bc8d0c256242b382f7aa6613f6de9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:00Z,use_quota=True,user_id='4ad0f32ba19040828d5a3b7fe2bfe9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Creating volume de45cc32-52f7-4f49-8b5a-be0f318ea360 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:06 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:06 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 1073741824 Apr 15 23:25:06 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6885c69-7443-42b9-9ab2-417364421afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0', 'volume_size': 1, 'snapshot_id': 'e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c88cca-06c3-4f48-8c4a-19ba9b06e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:06 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Volume volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 (a6464b2f-1b2e-4c26-babd-77a02695cfb0): created successfully Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c88cca-06c3-4f48-8c4a-19ba9b06e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (ec8fec5c-c514-4881-a0b6-e6a91c1d88a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:06 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fcea562a-cd1c-4e8d-8394-5355a01bc23b tempest-VolumeDependencyTests-1741778541 None] Created volume successfully. Apr 15 23:25:06 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-54bc1152-1100-4809-ad27-d15190a06b2c" returned: 0 in 0.428s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-54bc1152-1100-4809-ad27-d15190a06b2c" released by "delete_volume" :: held 0.916s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created reservations ['be4a3966-6473-473d-b2b2-f90d21480b4b', 'c5d9d2a4-a0b7-4d2a-99c7-54d1532790a7', '3ee47157-d349-4af4-a513-9f35ab9ed130', 'ebf53c37-5416-4b8a-b8c9-d34d6bb8c652'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:07 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:07 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-619775f3-7961-44a0-b26b-92254c2da3f4-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-619775f3-7961-44a0-b26b-92254c2da3f4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-quobyte-619775f3-7961-44a0-b26b-92254c2da3f4" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-619775f3-7961-44a0-b26b-92254c2da3f4" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3406eb72-ec21-4a78-b62e-8859b2e897bb]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:07 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 Apr 15 23:25:07 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:07 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 1073741824" returned: 0 in 0.552s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:07 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 Apr 15 23:25:07 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:07 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Deleted volume successfully. Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-1b9b7721-ae51-407b-b71d-8ab2341dcd26 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-54bc1152-1100-4809-ad27-d15190a06b2c-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:07 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4" returned: 0 in 0.523s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:07 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4 Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-af8e8c1f-dabf-403f-b9ed-c42f241503af" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:07 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-af8e8c1f-dabf-403f-b9ed-c42f241503af" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Deleting offline snapshot e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc of volume af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] snapshot_file for this snap is: volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c514710-8980-48e2-bea0-b1a500313d0f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:07 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360" returned: 0 in 0.439s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:07 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc Apr 15 23:25:07 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48683fbe-6ebd-4126-9f80-0b8f2fc4f1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de45cc32-52f7-4f49-8b5a-be0f318ea360', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb5d765-a6e5-4d56-871f-47dd6e435c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:07 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Volume volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 (de45cc32-52f7-4f49-8b5a-be0f318ea360): created successfully Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb5d765-a6e5-4d56-871f-47dd6e435c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Flow 'volume_create_manager' (14a69968-3344-4399-984a-ef8a79cc354d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e9c0ecb4-4f36-41be-b2fe-f5c158d7166a tempest-VolumesNegativeTest-498368187 None] Created volume successfully. Apr 15 23:25:08 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-619775f3-7961-44a0-b26b-92254c2da3f4" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-619775f3-7961-44a0-b26b-92254c2da3f4" released by "delete_volume" :: held 1.074s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created reservations ['8d5f5546-5a56-4eee-901d-6d1cc208bb56', 'd9945285-7fc1-4783-8bab-4ed7063f71eb', 'c107b326-3984-48dc-a3c4-d54eb5d0ef48', 'dc9fd200-a23e-46b2-92a7-69614005de76'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:08 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" returned: 0 in 0.523s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af8e8c1f-dabf-403f-b9ed-c42f241503af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3f7947-f90e-4be9-a16b-1da3f253e3ff]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:08 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:08 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:08 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af Apr 15 23:25:08 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:08 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.427s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:08 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Deleted volume successfully. Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee087031-b4f1-43b3-adc1-3686ada7938a tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-619775f3-7961-44a0-b26b-92254c2da3f4-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:08 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af" returned: 0 in 0.588s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:08 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc Apr 15 23:25:08 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-aafe8e64-9b73-488f-ac9b-e1ef6213b693-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-aafe8e64-9b73-488f-ac9b-e1ef6213b693-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-quobyte-aafe8e64-9b73-488f-ac9b-e1ef6213b693" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-aafe8e64-9b73-488f-ac9b-e1ef6213b693" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bda520-3b6a-45b3-a359-667867e12655]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:09 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:09 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc Apr 15 23:25:09 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:09 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 Apr 15 23:25:09 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:09 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af.e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" returned: 0 in 0.460s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:09 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693" returned: 0 in 0.517s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc" released by "_delete_snapshot" :: held 2.154s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-af8e8c1f-dabf-403f-b9ed-c42f241503af" released by "delete_snapshot" :: held 2.170s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:09 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693 Apr 15 23:25:09 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Created reservations ['cff7cdb6-0d70-4b32-a326-cb889cdb7fd7', '67004bbe-f2c1-4a53-b1af-e4cd63d7f8a5', '00886460-7d33-4cc4-97e2-ef2f833ae8cb', '6a12b0dc-14fc-4257-ada2-365b597cba3d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:09 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Delete snapshot completed successfully. Apr 15 23:25:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-79074069-4174-47cc-b979-411eabbe47a0 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-e9c7b4da-5986-44ed-a4b6-fb3ee3f3dffc-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:10 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-aafe8e64-9b73-488f-ac9b-e1ef6213b693" returned: 0 in 0.401s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-aafe8e64-9b73-488f-ac9b-e1ef6213b693" released by "delete_volume" :: held 0.941s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created reservations ['9d0c4ae1-c327-4667-8b9f-45cdc9e7abee', '313b6884-e808-418e-8896-9d229be6744f', '91fe465d-9e24-47de-8727-8eb599522b92', 'a483705d-9480-4834-8865-e82bea4b1f73'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:10 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:10 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-6b649f86-5e3b-4a44-970f-9ab4587552c5-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-6b649f86-5e3b-4a44-970f-9ab4587552c5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "cinder-quobyte-6b649f86-5e3b-4a44-970f-9ab4587552c5" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-6b649f86-5e3b-4a44-970f-9ab4587552c5" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7938ba8-1bcf-40db-a655-3e7a1c0cab17]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:10 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 Apr 15 23:25:10 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-af8e8c1f-dabf-403f-b9ed-c42f241503af-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-af8e8c1f-dabf-403f-b9ed-c42f241503af-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:10 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.498s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-af8e8c1f-dabf-403f-b9ed-c42f241503af" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:10 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Deleted volume successfully. Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3168b778-987a-4400-9f09-1c842a2f35f0 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-aafe8e64-9b73-488f-ac9b-e1ef6213b693-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-af8e8c1f-dabf-403f-b9ed-c42f241503af" acquired by "delete_volume" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d25c89-ce8e-445e-8639-22729116ade8]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:10 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af Apr 15 23:25:10 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:10 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5" returned: 0 in 0.540s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:10 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5 Apr 15 23:25:10 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:11 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af" returned: 0 in 0.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:11 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af Apr 15 23:25:11 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:11 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6b649f86-5e3b-4a44-970f-9ab4587552c5" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-quobyte-6b649f86-5e3b-4a44-970f-9ab4587552c5" released by "delete_volume" :: held 1.014s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Created reservations ['f69ced16-1417-4d41-8857-a12fc37f5e68', '58a63b57-d1ca-4a90-8de5-e0be6bd1c437', 'aac0de5b-c42e-4c21-aedd-c520ac4b6808', '6fd8b79d-166d-46cf-993f-4e29767e5193'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:11 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:11 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:11 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-af8e8c1f-dabf-403f-b9ed-c42f241503af" returned: 0 in 0.475s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-af8e8c1f-dabf-403f-b9ed-c42f241503af" released by "delete_volume" :: held 0.972s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Created reservations ['588acf53-93d1-4fec-ac1e-91053fe04784', '9c2a8786-b168-46e5-bb4d-7c121f09c578', 'efcf06b4-c865-4994-86a0-b290d69595b3', 'f56ec331-fbb4-431c-96b0-c8a7cafcd366'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:11 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.420s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:11 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:11 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:11 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Deleted volume successfully. Apr 15 23:25:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f2ddfed4-c137-4955-93f7-d57df9bc18a3 tempest-CreateVolumesFromSourceVolumeTest-1320145642 None] Lock "cinder-6b649f86-5e3b-4a44-970f-9ab4587552c5-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:12 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.407s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:12 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Deleted volume successfully. Apr 15 23:25:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-062f478a-a142-4401-8913-f250e4a7ea76 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-af8e8c1f-dabf-403f-b9ed-c42f241503af-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (3d66f20a-521c-4461-89d9-4520ebb0d538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fde07d5-1864-4766-ba9c-52eaf05ec7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fde07d5-1864-4766-ba9c-52eaf05ec7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177851226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7610b2fb-4d17-4b16-b868-11d985d95c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62569b1df30c418098b477615786d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:13Z,use_quota=True,user_id='27ae79f9841b4e4e8f8502925c09a60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eb8eb9-3261-4ec6-b386-173ff6368063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eb8eb9-3261-4ec6-b386-173ff6368063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43203d4-6fa4-460c-8089-79a7b79bce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43203d4-6fa4-460c-8089-79a7b79bce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7610b2fb-4d17-4b16-b868-11d985d95c43', 'volume_name': 'volume-7610b2fb-4d17-4b16-b868-11d985d95c43', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb90cb2-ee39-4535-ab23-96a1d4e6e1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb90cb2-ee39-4535-ab23-96a1d4e6e1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68107d3-edd2-4b79-ba5e-aca5dcf9f674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:13 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Volume 7610b2fb-4d17-4b16-b868-11d985d95c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7610b2fb-4d17-4b16-b868-11d985d95c43', 'volume_size': 1} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177851226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7610b2fb-4d17-4b16-b868-11d985d95c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62569b1df30c418098b477615786d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:13Z,use_quota=True,user_id='27ae79f9841b4e4e8f8502925c09a60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Creating volume 7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:13 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:13 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 1073741824 Apr 15 23:25:13 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:14 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 1073741824" returned: 0 in 0.607s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:14 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 Apr 15 23:25:14 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Flow 'volume_create_manager' (ea55e9cb-6fb6-4794-9ab3-d288787e6f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:14 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd4fb20-f436-4ad3-820e-56ca79f7d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43" returned: 0 in 0.523s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd4fb20-f436-4ad3-820e-56ca79f7d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad88ef9b-c142-4f72-9868-97f8e376f5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e597f3a85f45c8a79976807e932b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:15Z,use_quota=True,user_id='446b59758f2d4d20bfb0a38b6f958fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c34f2-3951-4f22-a7a6-a5c36d1be553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c34f2-3951-4f22-a7a6-a5c36d1be553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b57caa-c84c-41c6-94c3-087c0da74aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b57caa-c84c-41c6-94c3-087c0da74aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad88ef9b-c142-4f72-9868-97f8e376f5ca', 'volume_name': 'volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9db611e-f698-4a22-bde7-3430d2ea49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9db611e-f698-4a22-bde7-3430d2ea49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0305e2c-65e8-49d1-8161-1a286a592886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Volume ad88ef9b-c142-4f72-9868-97f8e376f5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca', 'volume_size': 1} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad88ef9b-c142-4f72-9868-97f8e376f5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e597f3a85f45c8a79976807e932b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:15Z,use_quota=True,user_id='446b59758f2d4d20bfb0a38b6f958fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Creating volume ad88ef9b-c142-4f72-9868-97f8e376f5ca {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:14 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68107d3-edd2-4b79-ba5e-aca5dcf9f674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7610b2fb-4d17-4b16-b868-11d985d95c43', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:14 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca 1073741824 Apr 15 23:25:14 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce28db74-0559-44c4-b8ed-7aaf4c9a4593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Volume volume-7610b2fb-4d17-4b16-b868-11d985d95c43 (7610b2fb-4d17-4b16-b868-11d985d95c43): created successfully Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce28db74-0559-44c4-b8ed-7aaf4c9a4593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (3d66f20a-521c-4461-89d9-4520ebb0d538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:14 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-388b6961-6499-4a11-b445-1a70ad25bb8a tempest-VolumeDependencyTests-1741778541 None] Created volume successfully. Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:14 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:14 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:15 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca 1073741824" returned: 0 in 0.519s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:15 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca Apr 15 23:25:15 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:15 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.433s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:15 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca" returned: 0 in 0.493s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0305e2c-65e8-49d1-8161-1a286a592886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b580df1-55ef-4a3e-9c2b-e3abedaebd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:25:15 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Volume volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca (ad88ef9b-c142-4f72-9868-97f8e376f5ca): created successfully Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b580df1-55ef-4a3e-9c2b-e3abedaebd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Flow 'volume_create_manager' (ea55e9cb-6fb6-4794-9ab3-d288787e6f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:15 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4fc8c94a-f5be-4345-9aa7-2c8c22f1ea08 tempest-CinderUnicodeTest-1166657829 None] Created volume successfully. Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (7fc90566-4df6-4672-b989-dc3181a038f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a35b3d9-358b-4225-a376-c4d273436243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a35b3d9-358b-4225-a376-c4d273436243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1867281179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93687a3a-2da9-4d57-9f8e-f0c06c4000fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62569b1df30c418098b477615786d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7610b2fb-4d17-4b16-b868-11d985d95c43,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:16Z,use_quota=True,user_id='27ae79f9841b4e4e8f8502925c09a60b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b309b88-57c1-425b-83b2-dbb73580e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b309b88-57c1-425b-83b2-dbb73580e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe50094-f561-4c3f-8e8b-57ed842a67a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe50094-f561-4c3f-8e8b-57ed842a67a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '93687a3a-2da9-4d57-9f8e-f0c06c4000fd', 'volume_name': 'volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd', 'volume_size': 1, 'source_volid': '7610b2fb-4d17-4b16-b868-11d985d95c43', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c5edc8-c647-40e5-82b8-866f50c6aae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c5edc8-c647-40e5-82b8-866f50c6aae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb265eee-3916-4ed8-a049-24ac82e741ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:15 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Volume 93687a3a-2da9-4d57-9f8e-f0c06c4000fd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd', 'volume_size': 1, 'source_volid': '7610b2fb-4d17-4b16-b868-11d985d95c43', 'source_volstatus': 'available'} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:15 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Cloning volume 7610b2fb-4d17-4b16-b868-11d985d95c43 to volume 93687a3a-2da9-4d57-9f8e-f0c06c4000fd Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Creating offline snapshot 803243c2-5a32-453a-b198-ec13514f2c65 of volume 7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2d912-480f-4d7d-bfcb-790e2c14dad5]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:15 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 Apr 15 23:25:15 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:16 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:16 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 1G Apr 15 23:25:16 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:16 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 1G" returned: 0 in 0.541s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7610b2fb-4d17-4b16-b868-11d985d95c43 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:16 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7610b2fb-4d17-4b16-b868-11d985d95c43 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 Apr 15 23:25:16 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:16 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Flow 'volume_create_manager' (30c0aa1e-0f75-4a1e-b15f-095f5806867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd3605b-2bab-4d7e-842a-89cc56e9adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd3605b-2bab-4d7e-842a-89cc56e9adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-765659568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b80483-aeff-4466-b269-d3203a937228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e597f3a85f45c8a79976807e932b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:17Z,use_quota=True,user_id='446b59758f2d4d20bfb0a38b6f958fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b0c3a8-243e-428d-8d11-753d54f6f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b0c3a8-243e-428d-8d11-753d54f6f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc23b01-29be-4843-94e0-ca03090c4303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc23b01-29be-4843-94e0-ca03090c4303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b80483-aeff-4466-b269-d3203a937228', 'volume_name': 'volume-32b80483-aeff-4466-b269-d3203a937228', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02b938d-dff1-4bf9-918c-d9f904a9590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02b938d-dff1-4bf9-918c-d9f904a9590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ced2721-65e6-4343-9cf1-eb6ad2a8fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:17 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Volume 32b80483-aeff-4466-b269-d3203a937228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b80483-aeff-4466-b269-d3203a937228', 'volume_size': 1} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:17 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7610b2fb-4d17-4b16-b868-11d985d95c43 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65" returned: 0 in 0.457s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:17 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 is being set with open permissions: ugo+rw Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:17 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 Apr 15 23:25:17 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:17 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65" returned: 0 in 0.424s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:17 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.info Apr 15 23:25:17 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:18 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.info" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:18 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.info is being set with open permissions: ugo+rw Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:18 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.info Apr 15 23:25:18 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:18 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.info" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] snapshot: 803243c2-5a32-453a-b198-ec13514f2c65, volume: 93687a3a-2da9-4d57-9f8e-f0c06c4000fd, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5567d1ad-9cc8-4059-b4c9-fe411f9f8ee5]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:18 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 Apr 15 23:25:18 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:19 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65" returned: 0 in 0.506s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7610b2fb-4d17-4b16-b868-11d985d95c43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d591b4e6-79fd-4d03-943a-a664ff66eb21]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:19 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 Apr 15 23:25:19 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:19 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43" returned: 0 in 0.621s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:25:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:19 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd Apr 15 23:25:19 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:22 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" returned: 0 in 2.506s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:22 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[89338936-d7d7-495e-bd8f-6e3828dcecd2]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:22 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 Apr 15 23:25:22 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:22 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43" returned: 0 in 0.629s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:22 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:25:22 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Converted 1024.00 MB image at 408.28 MB/s Apr 15 23:25:22 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd is being set with open permissions: ugo+rw Apr 15 23:25:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:22 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd Apr 15 23:25:22 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:23 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" returned: 0 in 0.422s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" released by "_copy_volume_from_snapshot" :: held 4.732s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-803243c2-5a32-453a-b198-ec13514f2c65" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-803243c2-5a32-453a-b198-ec13514f2c65" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Deleting offline snapshot 803243c2-5a32-453a-b198-ec13514f2c65 of volume 7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] snapshot_file for this snap is: volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e9219-db26-4782-b8f2-9a47054cd4d1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:23 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 Apr 15 23:25:23 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:23 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65" returned: 0 in 0.531s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7610b2fb-4d17-4b16-b868-11d985d95c43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[db57a672-580a-4fe2-bcd5-1fb20f2955a5]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:24 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 Apr 15 23:25:24 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:24 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43" returned: 0 in 0.488s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:24 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 Apr 15 23:25:24 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:24 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65" returned: 0 in 0.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:24 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65 Apr 15 23:25:24 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:25 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43.803243c2-5a32-453a-b198-ec13514f2c65" returned: 0 in 0.461s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-803243c2-5a32-453a-b198-ec13514f2c65" released by "_delete_snapshot" :: held 2.012s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.610s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.368s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-765659568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b80483-aeff-4466-b269-d3203a937228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e597f3a85f45c8a79976807e932b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:17Z,use_quota=True,user_id='446b59758f2d4d20bfb0a38b6f958fed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Creating volume 32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:25 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb265eee-3916-4ed8-a049-24ac82e741ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd', 'volume_size': 1, 'source_volid': '7610b2fb-4d17-4b16-b868-11d985d95c43', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:25 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 1073741824 Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f77cc7-7c59-4569-a06c-5aa80e9fd335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:25 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:25 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Volume volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd (93687a3a-2da9-4d57-9f8e-f0c06c4000fd): created successfully Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f77cc7-7c59-4569-a06c-5aa80e9fd335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Flow 'volume_create_manager' (7fc90566-4df6-4672-b989-dc3181a038f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:25 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-650dad94-366d-44c8-bc50-c9e36e81e4f8 tempest-VolumeDependencyTests-1741778541 None] Created volume successfully. Apr 15 23:25:25 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 1073741824" returned: 0 in 0.488s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:25 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 Apr 15 23:25:25 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-7610b2fb-4d17-4b16-b868-11d985d95c43-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-7610b2fb-4d17-4b16-b868-11d985d95c43-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-7610b2fb-4d17-4b16-b868-11d985d95c43" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-7610b2fb-4d17-4b16-b868-11d985d95c43" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:26 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ced2721-65e6-4343-9cf1-eb6ad2a8fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b80483-aeff-4466-b269-d3203a937228', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4690a7b8-47e0-41c1-933e-15cf9d57f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7414ed-5ebd-457b-b06b-6523ceba1863]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Volume volume-32b80483-aeff-4466-b269-d3203a937228 (32b80483-aeff-4466-b269-d3203a937228): created successfully Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4690a7b8-47e0-41c1-933e-15cf9d57f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Flow 'volume_create_manager' (30c0aa1e-0f75-4a1e-b15f-095f5806867e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:26 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7ab4b364-e172-4037-8cfd-e92159b7dd8f tempest-CinderUnicodeTest-1166657829 None] Created volume successfully. Apr 15 23:25:26 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 Apr 15 23:25:26 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:26 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43" returned: 0 in 0.490s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:26 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43 Apr 15 23:25:26 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:27 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7610b2fb-4d17-4b16-b868-11d985d95c43" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-7610b2fb-4d17-4b16-b868-11d985d95c43" released by "delete_volume" :: held 0.960s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Created reservations ['92b619bf-22c2-49a1-9684-fc6ad7800a53', 'c21ebd9e-398b-4b38-aa0e-37be2662c0ac', '0462c2ea-ed6f-4ba8-8a1c-c5cef85be3b5', '23639c1a-dc4b-471d-9df3-bc117f05f689'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:27 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:27 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-93687a3a-2da9-4d57-9f8e-f0c06c4000fd-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-93687a3a-2da9-4d57-9f8e-f0c06c4000fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[13966771-349b-4c15-b722-f68859a00e95]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:27 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd Apr 15 23:25:27 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Creating offline snapshot 92d0b79a-e0fb-4b15-9b8b-bbd183406d97 of volume 32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8177bf-8c8f-4404-925b-c16b8fbbde74]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:27 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 Apr 15 23:25:27 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:27 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.487s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Deleted volume successfully. Apr 15 23:25:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-41a98517-d498-4dfb-9d88-26ebd3dfce3d tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-7610b2fb-4d17-4b16-b868-11d985d95c43-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:28 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" returned: 0 in 0.506s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:28 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd Apr 15 23:25:28 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:28 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228" returned: 0 in 0.505s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:28 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 1G Apr 15 23:25:28 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:28 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" returned: 0 in 0.428s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-93687a3a-2da9-4d57-9f8e-f0c06c4000fd" released by "delete_volume" :: held 0.959s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Created reservations ['f4471ee0-26f0-4056-be8c-d2c36f12ab48', 'b198606b-faa8-494e-aa32-9f8f9b22f116', 'dfef9e24-f6c6-45e3-b81a-2b02da930a95', 'ceedb3a2-76ce-4420-a3f6-6c262f8022a7'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:28 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:28 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:28 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 1G" returned: 0 in 0.564s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b80483-aeff-4466-b269-d3203a937228 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:28 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b80483-aeff-4466-b269-d3203a937228 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 Apr 15 23:25:28 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:29 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.515s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Deleted volume successfully. Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da312948-f706-4912-86d5-f88fc833fee4 tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-93687a3a-2da9-4d57-9f8e-f0c06c4000fd-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:29 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b80483-aeff-4466-b269-d3203a937228 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97" returned: 0 in 0.419s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:29 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 is being set with open permissions: ugo+rw Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:29 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 Apr 15 23:25:29 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-a6464b2f-1b2e-4c26-babd-77a02695cfb0-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-a6464b2f-1b2e-4c26-babd-77a02695cfb0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "cinder-quobyte-a6464b2f-1b2e-4c26-babd-77a02695cfb0" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-a6464b2f-1b2e-4c26-babd-77a02695cfb0" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:29 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97" returned: 0 in 0.515s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3418744c-1dff-48b9-8036-b36ce8ac63ca]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:29 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.info Apr 15 23:25:29 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:29 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 Apr 15 23:25:29 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:30 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.info" returned: 0 in 0.450s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:30 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.info is being set with open permissions: ugo+rw Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:30 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.info Apr 15 23:25:30 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:30 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0" returned: 0 in 0.544s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:30 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0 Apr 15 23:25:30 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:30 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.info" returned: 0 in 0.425s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:30 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f2a99a90-f0b0-44c8-a102-4d7709352846 tempest-CinderUnicodeTest-1166657829 None] Create snapshot completed successfully Apr 15 23:25:30 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a6464b2f-1b2e-4c26-babd-77a02695cfb0" returned: 0 in 0.467s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-quobyte-a6464b2f-1b2e-4c26-babd-77a02695cfb0" released by "delete_volume" :: held 1.048s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Created reservations ['9cd82f2c-f399-4454-8fb8-c43633f495e0', 'dbca038a-814a-4763-be8c-8c4c1e617f15', '700aee2c-6029-4a2e-b992-f2099cce0fe5', '136ca157-041e-4eec-8e3d-7fbc283974a0'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "cinder-92d0b79a-e0fb-4b15-9b8b-bbd183406d97-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-92d0b79a-e0fb-4b15-9b8b-bbd183406d97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "cinder-quobyte-32b80483-aeff-4466-b269-d3203a937228" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:30 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:30 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-32b80483-aeff-4466-b269-d3203a937228" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "cinder-quobyte-92d0b79a-e0fb-4b15-9b8b-bbd183406d97" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-92d0b79a-e0fb-4b15-9b8b-bbd183406d97" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Deleting offline snapshot 92d0b79a-e0fb-4b15-9b8b-bbd183406d97 of volume 32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] snapshot_file for this snap is: volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7361be09-f3c1-47e1-afb6-d9f3da655e92]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:31 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 Apr 15 23:25:31 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:31 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.492s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:31 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Deleted volume successfully. Apr 15 23:25:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-f435d675-fd54-4dd0-bfae-b5263ff5f7ab tempest-VolumeDependencyTests-1741778541 None] Lock "cinder-a6464b2f-1b2e-4c26-babd-77a02695cfb0-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:31 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97" returned: 0 in 0.474s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b80483-aeff-4466-b269-d3203a937228(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:31 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ef108-1335-4cd6-8f05-4773b2dcc21e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:31 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 Apr 15 23:25:31 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:32 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228" returned: 0 in 0.574s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:32 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 Apr 15 23:25:32 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Acquiring lock "cinder-de45cc32-52f7-4f49-8b5a-be0f318ea360-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Lock "cinder-de45cc32-52f7-4f49-8b5a-be0f318ea360-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Acquiring lock "cinder-quobyte-de45cc32-52f7-4f49-8b5a-be0f318ea360" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Lock "cinder-quobyte-de45cc32-52f7-4f49-8b5a-be0f318ea360" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:32 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97" returned: 0 in 0.592s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf423898-3c50-480a-b8f0-336a04e4037a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:32 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97 Apr 15 23:25:32 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:32 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 Apr 15 23:25:32 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:33 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228.92d0b79a-e0fb-4b15-9b8b-bbd183406d97" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-92d0b79a-e0fb-4b15-9b8b-bbd183406d97" released by "_delete_snapshot" :: held 2.189s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-32b80483-aeff-4466-b269-d3203a937228" released by "delete_snapshot" :: held 2.201s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:33 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360" returned: 0 in 0.529s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Created reservations ['af8747fa-5c3e-4519-8428-c6986eb9f54f', '02465efd-ca0d-4d29-81da-2b5112a36453', '0adec4dd-ce2d-4768-9420-4bf5904a1b51', '7d9c1b92-30f5-413e-a04f-a66d620c4cbb'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:33 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360 Apr 15 23:25:33 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Delete snapshot completed successfully. Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-e05de6e8-556c-4505-b535-2e8d449a29dc tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-92d0b79a-e0fb-4b15-9b8b-bbd183406d97-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:33 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-de45cc32-52f7-4f49-8b5a-be0f318ea360" returned: 0 in 0.433s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Lock "cinder-quobyte-de45cc32-52f7-4f49-8b5a-be0f318ea360" released by "delete_volume" :: held 0.992s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Created reservations ['88f76d30-a6bd-402b-a589-f3d90c7974dc', '831753b6-2c05-4f0c-a1f4-6abec7ee4a47', '6f207601-ca13-449e-8559-f026749a4023', '3d1d0ae1-9411-47e0-9976-2c90b0391192'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:33 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:33 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "cinder-32b80483-aeff-4466-b269-d3203a937228-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-32b80483-aeff-4466-b269-d3203a937228-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "cinder-quobyte-32b80483-aeff-4466-b269-d3203a937228" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-32b80483-aeff-4466-b269-d3203a937228" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c903c8-63e0-4699-8d05-300b0edd6ae1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:34 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 Apr 15 23:25:34 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:34 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.469s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:34 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Deleted volume successfully. Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cab997b5-fcb6-43dc-9476-87ae3a747312 tempest-VolumesNegativeTest-498368187 None] Lock "cinder-de45cc32-52f7-4f49-8b5a-be0f318ea360-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:34 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228" returned: 0 in 0.549s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:34 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228 Apr 15 23:25:34 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:35 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-32b80483-aeff-4466-b269-d3203a937228" returned: 0 in 0.450s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-32b80483-aeff-4466-b269-d3203a937228" released by "delete_volume" :: held 1.036s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Created reservations ['57cbe739-6180-4bb6-a378-b57fcb987b32', 'ebba08e6-b6f0-4bc6-a04e-0c20c02ab654', '47509c7f-ef39-4754-bc94-775a1c93e2e1', 'f9f20cd6-c735-4359-9fe9-d94c9c69173f'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:35 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:35 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:35 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.455s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:35 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Deleted volume successfully. Apr 15 23:25:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-19a98ef3-66ec-47fc-be1e-1faed12b6ac8 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-32b80483-aeff-4466-b269-d3203a937228-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "cinder-ad88ef9b-c142-4f72-9868-97f8e376f5ca-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-ad88ef9b-c142-4f72-9868-97f8e376f5ca-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "cinder-quobyte-ad88ef9b-c142-4f72-9868-97f8e376f5ca" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-ad88ef9b-c142-4f72-9868-97f8e376f5ca" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0254d-9840-4939-b0c2-c4af366db519]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:36 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca Apr 15 23:25:36 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Flow 'volume_create_manager' (907a1a90-3c1d-41f7-9649-86b39ce393c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5457ac-824d-41b0-810b-03cc01f88a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5457ac-824d-41b0-810b-03cc01f88a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-50007458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551c500-f0b3-4818-852a-8517ffe00288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df5fcfafbb7446a8bf3615cfb66e8bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:36Z,use_quota=True,user_id='925e7b5e97c14ac5aa249a0c0b742b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243bc952-ad8c-48fe-ad58-d2fefe1a4a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243bc952-ad8c-48fe-ad58-d2fefe1a4a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b7816a-2dfd-4c46-8a4c-5246e82a75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b7816a-2dfd-4c46-8a4c-5246e82a75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6551c500-f0b3-4818-852a-8517ffe00288', 'volume_name': 'volume-6551c500-f0b3-4818-852a-8517ffe00288', 'volume_size': 2}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af25557c-b525-4186-8ed7-173ba6780857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af25557c-b525-4186-8ed7-173ba6780857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0f80c2-ad9a-41a0-b473-58318158d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:36 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Volume 6551c500-f0b3-4818-852a-8517ffe00288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6551c500-f0b3-4818-852a-8517ffe00288', 'volume_size': 2} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-50007458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551c500-f0b3-4818-852a-8517ffe00288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df5fcfafbb7446a8bf3615cfb66e8bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:36Z,use_quota=True,user_id='925e7b5e97c14ac5aa249a0c0b742b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Creating volume 6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:36 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 2147483648 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:36 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 2147483648 Apr 15 23:25:36 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:36 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca" returned: 0 in 0.666s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:36 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca Apr 15 23:25:36 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:37 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 2147483648" returned: 0 in 0.567s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:37 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 Apr 15 23:25:37 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:37 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ad88ef9b-c142-4f72-9868-97f8e376f5ca" returned: 0 in 0.571s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-quobyte-ad88ef9b-c142-4f72-9868-97f8e376f5ca" released by "delete_volume" :: held 1.273s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:37 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0f80c2-ad9a-41a0-b473-58318158d71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6551c500-f0b3-4818-852a-8517ffe00288', 'volume_size': 2}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4bbba0-5a01-45ad-bc69-3bcc0ee58c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Created reservations ['aefe5894-57bf-4069-ac34-59ec024beb10', 'c5098d38-1e9e-478b-8087-5dba7b8131f0', '0635a43c-74b4-43e6-a10b-5b6d55c67d6a', '9dfd8082-9903-4eed-9fd5-8f08a5965e76'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:37 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Volume volume-6551c500-f0b3-4818-852a-8517ffe00288 (6551c500-f0b3-4818-852a-8517ffe00288): created successfully Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4bbba0-5a01-45ad-bc69-3bcc0ee58c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Flow 'volume_create_manager' (907a1a90-3c1d-41f7-9649-86b39ce393c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:37 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c5e136b4-3237-4d7c-9746-737a383ce333 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Created volume successfully. Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:37 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:37 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:38 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.476s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Deleted volume successfully. Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-47625190-52c8-4574-8281-e7ee210ba666 tempest-CinderUnicodeTest-1166657829 None] Lock "cinder-ad88ef9b-c142-4f72-9868-97f8e376f5ca-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Creating offline snapshot c91fb32f-4260-4ded-b9b6-e769302b780d of volume 6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[10392691-67d8-4850-91f5-be66c27ad6c4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:38 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 Apr 15 23:25:38 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:39 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288" returned: 0 in 0.631s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d 2G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:39 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d 2G Apr 15 23:25:39 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:40 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d 2G" returned: 0 in 0.718s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6551c500-f0b3-4818-852a-8517ffe00288 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:40 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6551c500-f0b3-4818-852a-8517ffe00288 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d Apr 15 23:25:40 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:40 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6551c500-f0b3-4818-852a-8517ffe00288 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d" returned: 0 in 0.495s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:40 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d is being set with open permissions: ugo+rw Apr 15 23:25:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:40 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d Apr 15 23:25:40 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:41 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:41 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.info Apr 15 23:25:41 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:41 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.info" returned: 0 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:41 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.info is being set with open permissions: ugo+rw Apr 15 23:25:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:41 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.info Apr 15 23:25:41 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:42 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.info" returned: 0 in 0.445s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.285s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:42 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f8dfa7d7-fd06-487a-9c2d-6076a8903ebf tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Create snapshot completed successfully Apr 15 23:25:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "cinder-c91fb32f-4260-4ded-b9b6-e769302b780d-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-c91fb32f-4260-4ded-b9b6-e769302b780d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "cinder-quobyte-6551c500-f0b3-4818-852a-8517ffe00288" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-quobyte-6551c500-f0b3-4818-852a-8517ffe00288" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "cinder-quobyte-c91fb32f-4260-4ded-b9b6-e769302b780d" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-quobyte-c91fb32f-4260-4ded-b9b6-e769302b780d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Deleting offline snapshot c91fb32f-4260-4ded-b9b6-e769302b780d of volume 6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] snapshot_file for this snap is: volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7135b6cf-3bed-47d6-8350-7a2c67c9cab3]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:43 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d Apr 15 23:25:43 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:43 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d" returned: 0 in 0.538s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6551c500-f0b3-4818-852a-8517ffe00288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb16a99-b53f-4001-bbea-f1488cee2afc]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:43 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 Apr 15 23:25:43 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:44 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288" returned: 0 in 0.508s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:44 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d Apr 15 23:25:44 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:44 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d" returned: 0 in 0.451s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:44 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d Apr 15 23:25:44 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:44 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288.c91fb32f-4260-4ded-b9b6-e769302b780d" returned: 0 in 0.396s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=148,cinder:INSERT=56,cinder:UPDATE=197,cinder:DELETE=20 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-quobyte-c91fb32f-4260-4ded-b9b6-e769302b780d" released by "_delete_snapshot" :: held 1.955s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-quobyte-6551c500-f0b3-4818-852a-8517ffe00288" released by "delete_snapshot" :: held 1.970s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Created reservations ['99f19320-9077-4a48-81b7-b86bb99a6e1d', '0d89efb6-7d5f-408e-9f0e-0bfedf427125', '2f3e61a6-3a87-45e1-8c4e-837d245574d8', '7ec79a7a-7488-4ebd-9012-52cbbaddec31'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:45 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Delete snapshot completed successfully. Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2ed2e4f5-1038-432d-9658-79660d65e023 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-c91fb32f-4260-4ded-b9b6-e769302b780d-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "cinder-6551c500-f0b3-4818-852a-8517ffe00288-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-6551c500-f0b3-4818-852a-8517ffe00288-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "cinder-quobyte-6551c500-f0b3-4818-852a-8517ffe00288" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-quobyte-6551c500-f0b3-4818-852a-8517ffe00288" acquired by "delete_volume" :: waited 0.023s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a86ac28-73fc-4b2b-b3ac-2ad27afbd3ed]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:45 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 Apr 15 23:25:45 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:45 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288" returned: 0 in 0.526s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:45 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288 Apr 15 23:25:45 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:46 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6551c500-f0b3-4818-852a-8517ffe00288" returned: 0 in 0.450s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-quobyte-6551c500-f0b3-4818-852a-8517ffe00288" released by "delete_volume" :: held 1.009s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Created reservations ['c04bab19-19c8-4fde-8089-9f1f84cd9956', '9c53dd79-97b2-4f37-aa0d-a2d6b5c3d491', 'd738dbbc-894e-4def-8c16-254cbbd19b3a', 'a252d4b4-b778-4908-b235-db8466512178'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:46 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:25:46 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:46 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.494s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:25:46 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Deleted volume successfully. Apr 15 23:25:46 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c4aabd29-eb7e-42d3-b0d5-4ea9c930ae25 tempest-VolumesSnapshotNegativeTestJSON-314442632 None] Lock "cinder-6551c500-f0b3-4818-852a-8517ffe00288-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Flow 'volume_create_manager' (4c7370c8-e1ec-4004-854d-6aa05cbd06cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d262a184-4fd6-466f-8971-62de78c2a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d262a184-4fd6-466f-8971-62de78c2a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-422139357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19730aa5-ad80-44c7-af8f-c056ea994bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a90c521ec549f7b3176e508b7cc6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:47Z,use_quota=True,user_id='135cad98cea8418abf45ac856a9e4503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf965a6d-eba6-4865-90fb-2dbdebc92143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf965a6d-eba6-4865-90fb-2dbdebc92143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00a72c6-6f73-42f1-bb44-0d077580fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00a72c6-6f73-42f1-bb44-0d077580fffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19730aa5-ad80-44c7-af8f-c056ea994bda', 'volume_name': 'volume-19730aa5-ad80-44c7-af8f-c056ea994bda', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a235f740-b1e3-4f34-be9c-97b00bd25e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a235f740-b1e3-4f34-be9c-97b00bd25e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ac28c9-094b-42a4-823e-7512365de517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:47 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Volume 19730aa5-ad80-44c7-af8f-c056ea994bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19730aa5-ad80-44c7-af8f-c056ea994bda', 'volume_size': 1} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-422139357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19730aa5-ad80-44c7-af8f-c056ea994bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a90c521ec549f7b3176e508b7cc6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:47Z,use_quota=True,user_id='135cad98cea8418abf45ac856a9e4503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Creating volume 19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:47 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:47 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda 1073741824 Apr 15 23:25:47 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:47 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda 1073741824" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:47 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:47 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda Apr 15 23:25:47 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:48 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda" returned: 0 in 0.464s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:48 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:25:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ac28c9-094b-42a4-823e-7512365de517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19730aa5-ad80-44c7-af8f-c056ea994bda', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dade9253-94fd-4dd7-a30c-435f741396c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:48 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Volume volume-19730aa5-ad80-44c7-af8f-c056ea994bda (19730aa5-ad80-44c7-af8f-c056ea994bda): created successfully Apr 15 23:25:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dade9253-94fd-4dd7-a30c-435f741396c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:48 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Flow 'volume_create_manager' (4c7370c8-e1ec-4004-854d-6aa05cbd06cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:48 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-273f6c4f-017f-4f18-b975-6e0a931325c3 tempest-SnapshotDependencyTests-1685179282 None] Created volume successfully. Apr 15 23:25:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Creating offline snapshot c2d4a380-011a-43c5-a02c-7a16b3e19242 of volume 19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:25:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f0c6a7-751e-497a-b982-22840e10e30d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:49 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda Apr 15 23:25:49 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:50 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda" returned: 0 in 0.442s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:50 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 1G Apr 15 23:25:50 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:50 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 1G" returned: 0 in 0.432s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19730aa5-ad80-44c7-af8f-c056ea994bda -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:50 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19730aa5-ad80-44c7-af8f-c056ea994bda -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 Apr 15 23:25:50 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:50 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19730aa5-ad80-44c7-af8f-c056ea994bda -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242" returned: 0 in 0.408s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:50 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 is being set with open permissions: ugo+rw Apr 15 23:25:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:50 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 Apr 15 23:25:50 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:51 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242" returned: 0 in 0.383s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:51 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.info Apr 15 23:25:51 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:51 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.info" returned: 0 in 0.395s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:51 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.info is being set with open permissions: ugo+rw Apr 15 23:25:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:51 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.info Apr 15 23:25:51 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:52 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.info" returned: 0 in 0.385s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.496s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:52 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-558be27c-9edd-4203-b194-64c9672fcfe3 tempest-SnapshotDependencyTests-1685179282 None] Create snapshot completed successfully Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Flow 'volume_create_manager' (93f731c3-0d62-4b94-9084-63e8c9f5b3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161c47a4-de7f-488f-a27d-8071fd933626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161c47a4-de7f-488f-a27d-8071fd933626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25064689-30aa-48e2-997f-62f1b93c259f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a90c521ec549f7b3176e508b7cc6cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2d4a380-011a-43c5-a02c-7a16b3e19242,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:25:53Z,use_quota=True,user_id='135cad98cea8418abf45ac856a9e4503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64f514d-26e4-4393-bf61-718d34fa71bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64f514d-26e4-4393-bf61-718d34fa71bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f47f891-9fe4-4e60-84b2-907e5ef8b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f47f891-9fe4-4e60-84b2-907e5ef8b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25064689-30aa-48e2-997f-62f1b93c259f', 'volume_name': 'volume-25064689-30aa-48e2-997f-62f1b93c259f', 'volume_size': 1, 'snapshot_id': 'c2d4a380-011a-43c5-a02c-7a16b3e19242'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:52 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c65cbe8-620e-4b30-9f19-1829c9c32e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c65cbe8-620e-4b30-9f19-1829c9c32e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc63f35-d07f-4861-a19b-dcdafcd9fd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:53 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Volume 25064689-30aa-48e2-997f-62f1b93c259f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25064689-30aa-48e2-997f-62f1b93c259f', 'volume_size': 1, 'snapshot_id': 'c2d4a380-011a-43c5-a02c-7a16b3e19242'} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-quobyte-c2d4a380-011a-43c5-a02c-7a16b3e19242-25064689-30aa-48e2-997f-62f1b93c259f" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-c2d4a380-011a-43c5-a02c-7a16b3e19242-25064689-30aa-48e2-997f-62f1b93c259f" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Creating volume 25064689-30aa-48e2-997f-62f1b93c259f from snapshot c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-quobyte-25064689-30aa-48e2-997f-62f1b93c259f" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-25064689-30aa-48e2-997f-62f1b93c259f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] snapshot: c2d4a380-011a-43c5-a02c-7a16b3e19242, volume: 25064689-30aa-48e2-997f-62f1b93c259f, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e6f14-1913-4dda-84ab-777d84581afd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:53 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 Apr 15 23:25:53 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:53 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242" returned: 0 in 0.450s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19730aa5-ad80-44c7-af8f-c056ea994bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb0cca-3844-47e1-922a-c770601cc2fe]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:53 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda Apr 15 23:25:53 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:53 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda" returned: 0 in 0.459s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:25:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:54 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f Apr 15 23:25:54 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:55 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f" returned: 0 in 1.873s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:55 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f6564f-a6c2-42b5-b08c-6ad5ab953362]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:55 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda Apr 15 23:25:55 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:56 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda" returned: 0 in 0.573s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:25:56 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Converted 1024.00 MB image at 546.36 MB/s Apr 15 23:25:56 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f is being set with open permissions: ugo+rw Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:56 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f Apr 15 23:25:56 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:56 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f" returned: 0 in 0.386s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-25064689-30aa-48e2-997f-62f1b93c259f" released by "_copy_volume_from_snapshot" :: held 3.794s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-c2d4a380-011a-43c5-a02c-7a16b3e19242-25064689-30aa-48e2-997f-62f1b93c259f" released by "_create_volume_from_snapshot" :: held 3.812s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.821s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=208,cinder:SELECT=146,cinder:INSERT=44,cinder:DELETE=14 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc63f35-d07f-4861-a19b-dcdafcd9fd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25064689-30aa-48e2-997f-62f1b93c259f', 'volume_size': 1, 'snapshot_id': 'c2d4a380-011a-43c5-a02c-7a16b3e19242'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef58ed4-6e46-45f3-8b76-e6af48fc8fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:25:56 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Volume volume-25064689-30aa-48e2-997f-62f1b93c259f (25064689-30aa-48e2-997f-62f1b93c259f): created successfully Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef58ed4-6e46-45f3-8b76-e6af48fc8fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:25:56 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Flow 'volume_create_manager' (93f731c3-0d62-4b94-9084-63e8c9f5b3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:25:56 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-2f1d4131-13e5-4214-a68d-45863fe51327 tempest-SnapshotDependencyTests-1685179282 None] Created volume successfully. Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-c2d4a380-011a-43c5-a02c-7a16b3e19242-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-c2d4a380-011a-43c5-a02c-7a16b3e19242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-quobyte-19730aa5-ad80-44c7-af8f-c056ea994bda" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-19730aa5-ad80-44c7-af8f-c056ea994bda" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-quobyte-c2d4a380-011a-43c5-a02c-7a16b3e19242" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-c2d4a380-011a-43c5-a02c-7a16b3e19242" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Deleting offline snapshot c2d4a380-011a-43c5-a02c-7a16b3e19242 of volume 19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] snapshot_file for this snap is: volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38fc84-8018-46f1-b414-551f9dee463e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:57 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 Apr 15 23:25:57 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:57 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242" returned: 0 in 0.457s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19730aa5-ad80-44c7-af8f-c056ea994bda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[617535b4-ffc3-4765-94b8-1d7dfe2a182f]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:57 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda Apr 15 23:25:57 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:58 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda" returned: 0 in 0.437s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:58 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 Apr 15 23:25:58 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:58 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242" returned: 0 in 0.422s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:58 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242 Apr 15 23:25:58 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:58 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda.c2d4a380-011a-43c5-a02c-7a16b3e19242" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-c2d4a380-011a-43c5-a02c-7a16b3e19242" released by "_delete_snapshot" :: held 1.785s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-19730aa5-ad80-44c7-af8f-c056ea994bda" released by "delete_snapshot" :: held 1.797s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Created reservations ['183a111f-040c-4d1e-ae7b-18dbcbbb249d', '6659b6b8-d53d-40c0-a0f9-77a133596e7d', '823e09d0-3b39-4438-9d27-346bea1acc4f', 'ddd92d3f-6d7c-4016-8708-231ecf52a253'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:25:59 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Delete snapshot completed successfully. Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-46c45f1f-d624-41d0-82be-44c7b8a7dfc3 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-c2d4a380-011a-43c5-a02c-7a16b3e19242-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-19730aa5-ad80-44c7-af8f-c056ea994bda-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-19730aa5-ad80-44c7-af8f-c056ea994bda-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-quobyte-19730aa5-ad80-44c7-af8f-c056ea994bda" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-19730aa5-ad80-44c7-af8f-c056ea994bda" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9adb686-eae3-4298-ab25-897c168c9ff4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:59 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda Apr 15 23:25:59 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:25:59 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda" returned: 0 in 0.454s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:25:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:25:59 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda Apr 15 23:25:59 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:00 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-19730aa5-ad80-44c7-af8f-c056ea994bda" returned: 0 in 0.394s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-19730aa5-ad80-44c7-af8f-c056ea994bda" released by "delete_volume" :: held 0.876s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Created reservations ['734f52f3-acea-4657-a5dc-1462a03cdfc6', '30d44f7f-5d6d-4582-b22a-2239d8e474c7', 'adbb901c-2fd4-454a-a948-2cbb4c13f5d5', '944f8721-aeaf-4531-9928-487489404d48'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:00 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:00 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-25064689-30aa-48e2-997f-62f1b93c259f-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-25064689-30aa-48e2-997f-62f1b93c259f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "cinder-quobyte-25064689-30aa-48e2-997f-62f1b93c259f" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-25064689-30aa-48e2-997f-62f1b93c259f" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[f663a03d-2b32-46b5-b983-a2087e370803]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:00 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f Apr 15 23:26:00 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:00 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.420s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Deleted volume successfully. Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-31679262-e803-4f1e-8f94-39402d63ae9d tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-19730aa5-ad80-44c7-af8f-c056ea994bda-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:00 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f" returned: 0 in 0.459s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:00 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f Apr 15 23:26:00 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:01 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-25064689-30aa-48e2-997f-62f1b93c259f" returned: 0 in 0.387s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-quobyte-25064689-30aa-48e2-997f-62f1b93c259f" released by "delete_volume" :: held 0.872s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Created reservations ['e98ed3ef-b8b4-4643-9421-b1a94a8caa71', 'cc3f1e37-200d-40f3-9aa2-aa513dde40e3', '8ea3c5e3-dca7-466b-80ad-d1df36b34e6c', '28e25258-e372-4117-9c04-7e5d04607943'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:01 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:01 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:01 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.431s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:01 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Deleted volume successfully. Apr 15 23:26:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-42eccc79-7799-403a-bfe6-c5e86d92a226 tempest-SnapshotDependencyTests-1685179282 None] Lock "cinder-25064689-30aa-48e2-997f-62f1b93c259f-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:11 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=32,cinder:INSERT=14,cinder:UPDATE=41,cinder:DELETE=5 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:26:11 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=21,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (1534092e-987b-4ab6-814f-dea4b31f85cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbd8c69-a3f5-4781-baf9-3324416ff43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbd8c69-a3f5-4781-baf9-3324416ff43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50617977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe0a2ec-1bb6-45a2-81b4-e281e3285db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14ad58-500f-4a3e-b827-83ae5ef0ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14ad58-500f-4a3e-b827-83ae5ef0ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feaed376-6201-4584-919f-02754d26885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feaed376-6201-4584-919f-02754d26885d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe0a2ec-1bb6-45a2-81b4-e281e3285db1', 'volume_name': 'volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf68fdd-50ad-4a22-b928-355a69748123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf68fdd-50ad-4a22-b928-355a69748123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5301335d-1409-47a9-b6fb-b2c38d86e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume 7fe0a2ec-1bb6-45a2-81b4-e281e3285db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1', 'volume_size': 1} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50617977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe0a2ec-1bb6-45a2-81b4-e281e3285db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Creating volume 7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:14 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (1184eb86-8188-4094-acd4-4f84903c835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c413a515-5870-4b0b-a73c-9363e2d670ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 1073741824 Apr 15 23:26:14 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c413a515-5870-4b0b-a73c-9363e2d670ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674135077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a992810-3865-499e-9a6a-5f8bf9abcc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90412814-4652-49b8-b382-e24063b9fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90412814-4652-49b8-b382-e24063b9fb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeb6dac-0e0e-46ec-b2cf-614c2e4b3c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeb6dac-0e0e-46ec-b2cf-614c2e4b3c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a992810-3865-499e-9a6a-5f8bf9abcc6f', 'volume_name': 'volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9db2f5f-dcbb-4eae-a31c-dea5c911d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9db2f5f-dcbb-4eae-a31c-dea5c911d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072c365c-ff7e-4fe2-be45-0afd47f9a4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Volume 6a992810-3865-499e-9a6a-5f8bf9abcc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f', 'volume_size': 1} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (8aa6ed63-e348-4cf3-b2a0-0367e3844dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186ff450-2423-47e0-bb8f-30740e45fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186ff450-2423-47e0-bb8f-30740e45fd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1659464221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2472f0f8-f1b6-4217-86a2-b1739d1520db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (accd309f-6b45-43f6-8e1a-9af65451435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (accd309f-6b45-43f6-8e1a-9af65451435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6d5d08-26db-4ad6-b5e0-c22522b9de09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6d5d08-26db-4ad6-b5e0-c22522b9de09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2472f0f8-f1b6-4217-86a2-b1739d1520db', 'volume_name': 'volume-2472f0f8-f1b6-4217-86a2-b1739d1520db', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cfb143-d7ee-44fe-b892-6137613ac940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cfb143-d7ee-44fe-b892-6137613ac940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3385f79-82c2-4b5a-b5b9-90a6e0db60cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Volume 2472f0f8-f1b6-4217-86a2-b1739d1520db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2472f0f8-f1b6-4217-86a2-b1739d1520db', 'volume_size': 1} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (eb0a407b-4e39-4f40-94f5-248d0456649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f46f4ef-686c-4828-8b1c-9df1c51f4700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f46f4ef-686c-4828-8b1c-9df1c51f4700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1679153918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd95f0e-4b97-4266-8592-7453cf497e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c579a8c167946b99d40faa745042c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='e559e45143bb46ca953d07d48eec6647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb328f2f-2c23-4e66-a20e-0c7a62e7658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb328f2f-2c23-4e66-a20e-0c7a62e7658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd04f116-4ce7-4d47-8a1e-60aecb16dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd04f116-4ce7-4d47-8a1e-60aecb16dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd95f0e-4b97-4266-8592-7453cf497e6d', 'volume_name': 'volume-4bd95f0e-4b97-4266-8592-7453cf497e6d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76adb04-141a-455a-9ad4-6773176f3356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76adb04-141a-455a-9ad4-6773176f3356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8cfd3d-2307-4964-85c0-ba2181169f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Volume 4bd95f0e-4b97-4266-8592-7453cf497e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd95f0e-4b97-4266-8592-7453cf497e6d', 'volume_size': 1} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (0d3f25f5-7ec6-4f96-9f71-1038e1e5ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3580a5-3cf9-4328-a52a-ae447d16dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3580a5-3cf9-4328-a52a-ae447d16dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075905372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6541476a-5b07-4490-b714-a4e9bd732244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:15Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af75db03-e2b1-48d6-af54-0a2dc9478e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af75db03-e2b1-48d6-af54-0a2dc9478e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000ca9a9-b17e-4cc3-a889-485eedf9122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000ca9a9-b17e-4cc3-a889-485eedf9122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6541476a-5b07-4490-b714-a4e9bd732244', 'volume_name': 'volume-6541476a-5b07-4490-b714-a4e9bd732244', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:14 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60532b3-7946-4e02-87f1-d59c9ae06bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60532b3-7946-4e02-87f1-d59c9ae06bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55359371-6243-4ec9-b819-9247d3147b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:14 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Volume 6541476a-5b07-4490-b714-a4e9bd732244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6541476a-5b07-4490-b714-a4e9bd732244', 'volume_size': 1} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (209e184e-3b7d-4098-847d-9bce3789b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:14 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5521544-dbb6-4402-b306-fc3811246185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5521544-dbb6-4402-b306-fc3811246185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1752096223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13f74b2-b08f-496e-a37d-eda35cfc954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:15Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bc12fe-e777-4856-817a-eb01c6948d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bc12fe-e777-4856-817a-eb01c6948d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fdf9d6-3710-43d0-8b6d-9b8a76a8dbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fdf9d6-3710-43d0-8b6d-9b8a76a8dbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13f74b2-b08f-496e-a37d-eda35cfc954e', 'volume_name': 'volume-a13f74b2-b08f-496e-a37d-eda35cfc954e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339ba373-3c1e-4607-a0fd-c9832ab239ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339ba373-3c1e-4607-a0fd-c9832ab239ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a720e79-1484-46b3-bf83-b1a30a7b8c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Volume a13f74b2-b08f-496e-a37d-eda35cfc954e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13f74b2-b08f-496e-a37d-eda35cfc954e', 'volume_size': 1} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:15 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (40606686-07ab-4be8-bdb6-ccb9adc9c560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12621d12-fa9d-4635-a408-61687614a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12621d12-fa9d-4635-a408-61687614a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566762630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734bb750-5a7c-48f0-9bc3-aa66f3699681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:15Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12126b5-23c7-4811-a7eb-629ae7144893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12126b5-23c7-4811-a7eb-629ae7144893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45851b8-fa13-45ef-9795-40b5bebf86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45851b8-fa13-45ef-9795-40b5bebf86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734bb750-5a7c-48f0-9bc3-aa66f3699681', 'volume_name': 'volume-734bb750-5a7c-48f0-9bc3-aa66f3699681', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2add9880-a3fe-4082-a3d3-4b2752e26377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2add9880-a3fe-4082-a3d3-4b2752e26377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35632547-cd11-4c88-a379-708e059faa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Volume 734bb750-5a7c-48f0-9bc3-aa66f3699681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734bb750-5a7c-48f0-9bc3-aa66f3699681', 'volume_size': 1} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 1073741824" returned: 0 in 0.915s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:15 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 Apr 15 23:26:15 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:15 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.527s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:15 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" returned: 0 in 0.464s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674135077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a992810-3865-499e-9a6a-5f8bf9abcc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Creating volume 6a992810-3865-499e-9a6a-5f8bf9abcc6f {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:15 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5301335d-1409-47a9-b6fb-b2c38d86e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f 1073741824 Apr 15 23:26:15 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82badbe9-a347-4f46-a37c-b7d86a3f748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:15 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 (7fe0a2ec-1bb6-45a2-81b4-e281e3285db1): created successfully Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82badbe9-a347-4f46-a37c-b7d86a3f748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:15 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (1534092e-987b-4ab6-814f-dea4b31f85cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:15 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3a107177-ff86-4922-9311-f9d9177c4d35 tempest-CreateVolumesFromSnapshotTest-832247679 None] Created volume successfully. Apr 15 23:26:16 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f 1073741824" returned: 0 in 0.558s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:16 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f Apr 15 23:26:16 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:16 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.189s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1659464221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2472f0f8-f1b6-4217-86a2-b1739d1520db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Creating volume 2472f0f8-f1b6-4217-86a2-b1739d1520db {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:16 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072c365c-ff7e-4fe2-be45-0afd47f9a4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:16 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db 1073741824 Apr 15 23:26:16 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0934cb-4663-4f83-97e3-f8ebe51f32f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:16 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Volume volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f (6a992810-3865-499e-9a6a-5f8bf9abcc6f): created successfully Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0934cb-4663-4f83-97e3-f8ebe51f32f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:16 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (1184eb86-8188-4094-acd4-4f84903c835d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:16 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a155f8da-bfe6-41c2-bc14-5c4206782cf5 tempest-CreateVolumesFromImageTest-1765559565 None] Created volume successfully. Apr 15 23:26:17 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db 1073741824" returned: 0 in 0.588s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:17 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db Apr 15 23:26:17 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:17 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db" returned: 0 in 0.458s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.127s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1679153918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd95f0e-4b97-4266-8592-7453cf497e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c579a8c167946b99d40faa745042c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:14Z,use_quota=True,user_id='e559e45143bb46ca953d07d48eec6647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Creating volume 4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:17 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3385f79-82c2-4b5a-b5b9-90a6e0db60cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2472f0f8-f1b6-4217-86a2-b1739d1520db', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:17 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d 1073741824 Apr 15 23:26:17 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d597bdf0-babc-4922-ba9a-808e4a1c481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:17 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Volume volume-2472f0f8-f1b6-4217-86a2-b1739d1520db (2472f0f8-f1b6-4217-86a2-b1739d1520db): created successfully Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d597bdf0-babc-4922-ba9a-808e4a1c481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:17 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (8aa6ed63-e348-4cf3-b2a0-0367e3844dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:17 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c54bd063-20fd-491b-b19f-265b4738676f tempest-CreateVolumesFromImageTest-1765559565 None] Created volume successfully. Apr 15 23:26:18 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d 1073741824" returned: 0 in 0.459s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:18 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d Apr 15 23:26:18 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:18 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d" returned: 0 in 0.438s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.920s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075905372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6541476a-5b07-4490-b714-a4e9bd732244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:15Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Creating volume 6541476a-5b07-4490-b714-a4e9bd732244 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:18 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8cfd3d-2307-4964-85c0-ba2181169f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd95f0e-4b97-4266-8592-7453cf497e6d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d0c0d5-6fc9-4a7b-8af9-fb8b65d0aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:18 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 1073741824 Apr 15 23:26:18 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:18 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Volume volume-4bd95f0e-4b97-4266-8592-7453cf497e6d (4bd95f0e-4b97-4266-8592-7453cf497e6d): created successfully Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d0c0d5-6fc9-4a7b-8af9-fb8b65d0aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:18 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (eb0a407b-4e39-4f40-94f5-248d0456649c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:18 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f942ca63-04eb-45de-99a5-fb3df4712218 tempest-VolumeDependencyTests-2019173142 None] Created volume successfully. Apr 15 23:26:19 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 1073741824" returned: 0 in 0.522s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:19 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 Apr 15 23:26:19 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:19 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244" returned: 0 in 0.474s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.753s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1752096223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13f74b2-b08f-496e-a37d-eda35cfc954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:15Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Creating volume a13f74b2-b08f-496e-a37d-eda35cfc954e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:19 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:19 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e 1073741824 Apr 15 23:26:19 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55359371-6243-4ec9-b819-9247d3147b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6541476a-5b07-4490-b714-a4e9bd732244', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9138290-4528-4806-8f85-f300acedbd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:19 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Volume volume-6541476a-5b07-4490-b714-a4e9bd732244 (6541476a-5b07-4490-b714-a4e9bd732244): created successfully Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9138290-4528-4806-8f85-f300acedbd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:19 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (0d3f25f5-7ec6-4f96-9f71-1038e1e5ee76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:19 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b505f96e-f850-4334-9f7e-beabcf07b4c8 tempest-CreateVolumesFromImageTest-1765559565 None] Created volume successfully. Apr 15 23:26:20 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e 1073741824" returned: 0 in 0.499s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:20 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e Apr 15 23:26:20 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:20 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e" returned: 0 in 0.415s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.528s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566762630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734bb750-5a7c-48f0-9bc3-aa66f3699681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081496da90704ae2ae800b32bc8f478c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:15Z,use_quota=True,user_id='c0830e015a4245e683fac13d4347a6d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Creating volume 734bb750-5a7c-48f0-9bc3-aa66f3699681 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:20 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a720e79-1484-46b3-bf83-b1a30a7b8c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13f74b2-b08f-496e-a37d-eda35cfc954e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:20 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 1073741824 Apr 15 23:26:20 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f3de89-d29a-4eef-aead-607db4c73016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:20 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Volume volume-a13f74b2-b08f-496e-a37d-eda35cfc954e (a13f74b2-b08f-496e-a37d-eda35cfc954e): created successfully Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f3de89-d29a-4eef-aead-607db4c73016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:20 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (209e184e-3b7d-4098-847d-9bce3789b140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:20 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-88c589a4-4b7d-4412-aa20-24d1149dfd85 tempest-CreateVolumesFromImageTest-1765559565 None] Created volume successfully. Apr 15 23:26:21 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 1073741824" returned: 0 in 0.524s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:21 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 Apr 15 23:26:21 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:21 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681" returned: 0 in 0.463s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.172s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35632547-cd11-4c88-a379-708e059faa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734bb750-5a7c-48f0-9bc3-aa66f3699681', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b77d47-0d64-4450-b97b-5fb1445aba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Creating offline snapshot da5f7893-0c32-4149-889e-8e3c80759398 of volume 7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:26:21 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Volume volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 (734bb750-5a7c-48f0-9bc3-aa66f3699681): created successfully Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b77d47-0d64-4450-b97b-5fb1445aba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Flow 'volume_create_manager' (40606686-07ab-4be8-bdb6-ccb9adc9c560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d569625-7c34-414c-aafa-f3ad04f5da1a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:21 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:21 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a28f671e-1c08-4c3b-b88c-b5c397df9a2b tempest-CreateVolumesFromImageTest-1765559565 None] Created volume successfully. Apr 15 23:26:21 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 Apr 15 23:26:21 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:22 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" returned: 0 in 0.495s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:22 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 1G Apr 15 23:26:22 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-734bb750-5a7c-48f0-9bc3-aa66f3699681-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-734bb750-5a7c-48f0-9bc3-aa66f3699681-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-quobyte-734bb750-5a7c-48f0-9bc3-aa66f3699681" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-734bb750-5a7c-48f0-9bc3-aa66f3699681" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb763709-ea00-4490-a477-3d23a28e9e83]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:22 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 1G" returned: 0 in 0.607s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:22 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:22 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 Apr 15 23:26:22 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:22 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 Apr 15 23:26:22 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:23 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398" returned: 0 in 0.529s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:23 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 is being set with open permissions: ugo+rw Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:23 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681" returned: 0 in 0.560s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:23 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 Apr 15 23:26:23 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:23 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681 Apr 15 23:26:23 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:23 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398" returned: 0 in 0.422s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:23 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-734bb750-5a7c-48f0-9bc3-aa66f3699681" returned: 0 in 0.468s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-734bb750-5a7c-48f0-9bc3-aa66f3699681" released by "delete_volume" :: held 1.056s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:23 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.info Apr 15 23:26:23 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:23 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Created reservations ['d956d45b-90a2-4efa-a631-3d5f383b55cc', 'fe7806d8-97ce-49dc-a0f1-c8a29555e90b', '38d27990-e652-479d-9865-864a8714aace', '695669c5-b3f7-4806-81ab-11ce1f89d386'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:24 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:24 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:24 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.info" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:24 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.info is being set with open permissions: ugo+rw Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:24 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.info Apr 15 23:26:24 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:24 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:24 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Deleted volume successfully. Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-28c4b19a-6c5b-4238-9fae-a1b3bf5d7863 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-734bb750-5a7c-48f0-9bc3-aa66f3699681-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:24 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.info" returned: 0 in 0.483s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.104s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.022s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Creating offline snapshot fc73db56-03c7-4c8d-9a79-ea459f64de85 of volume 4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fea7a4-e5a5-4b22-94a6-75431f0095e6]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:24 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:24 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-f571571b-6e5d-4347-94e4-3095ac01a6c4 tempest-CreateVolumesFromSnapshotTest-832247679 None] Create snapshot completed successfully Apr 15 23:26:24 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d Apr 15 23:26:24 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-a13f74b2-b08f-496e-a37d-eda35cfc954e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-a13f74b2-b08f-496e-a37d-eda35cfc954e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-quobyte-a13f74b2-b08f-496e-a37d-eda35cfc954e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-a13f74b2-b08f-496e-a37d-eda35cfc954e" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb39f9-848e-406e-8385-f1f0a5387760]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:25 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e Apr 15 23:26:25 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:25 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d" returned: 0 in 0.659s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:25 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 1G Apr 15 23:26:25 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:25 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e" returned: 0 in 0.600s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:25 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:25 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e Apr 15 23:26:25 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:26 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 1G" returned: 0 in 0.646s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd95f0e-4b97-4266-8592-7453cf497e6d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:26 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd95f0e-4b97-4266-8592-7453cf497e6d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 Apr 15 23:26:26 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:26 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (ca32f0e2-a591-4767-bec2-6a3cb46b88cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95f17fc-c432-4aa5-bfae-2b1bb1e8e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a13f74b2-b08f-496e-a37d-eda35cfc954e" returned: 0 in 0.620s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95f17fc-c432-4aa5-bfae-2b1bb1e8e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663040672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5030c5-b2ce-4958-9621-bce79f887e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:26Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2cac5e-5864-4a55-97d9-dbac0b2cb1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2cac5e-5864-4a55-97d9-dbac0b2cb1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692b621f-f280-4e1d-afbd-3bb3fa17b1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692b621f-f280-4e1d-afbd-3bb3fa17b1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5030c5-b2ce-4958-9621-bce79f887e2d', 'volume_name': 'volume-1f5030c5-b2ce-4958-9621-bce79f887e2d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeebf5df-c429-4a23-a92a-611ab61ffdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeebf5df-c429-4a23-a92a-611ab61ffdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500a5e2e-0fc0-49b2-84a6-a34055eb05e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume 1f5030c5-b2ce-4958-9621-bce79f887e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5030c5-b2ce-4958-9621-bce79f887e2d', 'volume_size': 1} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-a13f74b2-b08f-496e-a37d-eda35cfc954e" released by "delete_volume" :: held 1.301s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Created reservations ['2ecda6a3-5088-4c9c-9ad6-b71af3842cb8', 'b7b2b3bf-f4ff-4a0c-a6d9-189f5f654b26', 'c7829734-85fa-4910-8359-16823041bed0', 'd4fd6335-9d4d-4fe8-86db-273168556744'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (ba69251d-7349-4cc7-896c-a15774153970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6194cb3f-bdb4-495c-902b-add1fd91c7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6194cb3f-bdb4-495c-902b-add1fd91c7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782680587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1fa746-71e2-4ad2-ba22-5f580f618d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:26Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c891e77f-0fbc-4d4d-b464-8636ba883059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c891e77f-0fbc-4d4d-b464-8636ba883059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77effc8f-3833-4dba-9856-e7b1e974a612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77effc8f-3833-4dba-9856-e7b1e974a612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e1fa746-71e2-4ad2-ba22-5f580f618d05', 'volume_name': 'volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6472a6b7-0c0e-4c26-9c9a-3c19fcb5e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6472a6b7-0c0e-4c26-9c9a-3c19fcb5e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedeac8d-d58e-4572-b3ad-e4891ad1b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume 7e1fa746-71e2-4ad2-ba22-5f580f618d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05', 'volume_size': 1} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:26 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:26 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:26 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd95f0e-4b97-4266-8592-7453cf497e6d -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85" returned: 0 in 0.587s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:26 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 is being set with open permissions: ugo+rw Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:26 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 Apr 15 23:26:26 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (91748a46-65d0-41d6-bd46-ea1ee35e5c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe898115-f1dc-403d-944c-c174bdaf9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe898115-f1dc-403d-944c-c174bdaf9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43211358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2094f948-aaf3-42c5-9303-02314a3e9035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:27Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235d2f82-c12b-4fe3-8948-c74ccc67015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235d2f82-c12b-4fe3-8948-c74ccc67015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7544242-a745-40bc-b922-0da6f28244f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7544242-a745-40bc-b922-0da6f28244f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2094f948-aaf3-42c5-9303-02314a3e9035', 'volume_name': 'volume-2094f948-aaf3-42c5-9303-02314a3e9035', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a22c68f-cd6e-4c63-b681-a6c38430ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a22c68f-cd6e-4c63-b681-a6c38430ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db838189-dfdd-496f-9159-389008d0633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:26 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume 2094f948-aaf3-42c5-9303-02314a3e9035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2094f948-aaf3-42c5-9303-02314a3e9035', 'volume_size': 1} Apr 15 23:26:26 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (b7b28e63-73ad-4c13-bb0d-950a93d5c0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5625a6b1-75af-4690-9c87-46877db24769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5625a6b1-75af-4690-9c87-46877db24769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789237158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2fab93-3f14-4c3d-ae2d-c549fd15493e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:27Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e1f382-2a65-46b2-85f9-d43e90562369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e1f382-2a65-46b2-85f9-d43e90562369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d79ab1b-8f9d-4a8c-a27b-c586d5b18b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d79ab1b-8f9d-4a8c-a27b-c586d5b18b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2fab93-3f14-4c3d-ae2d-c549fd15493e', 'volume_name': 'volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b75c75-993b-4d9c-983c-a72bb80aa24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b75c75-993b-4d9c-983c-a72bb80aa24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c2a885-bdd4-4cac-a9f6-da052e064480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume ac2fab93-3f14-4c3d-ae2d-c549fd15493e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e', 'volume_size': 1} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-6541476a-5b07-4490-b714-a4e9bd732244-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-6541476a-5b07-4490-b714-a4e9bd732244-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:27 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-quobyte-6541476a-5b07-4490-b714-a4e9bd732244" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.731s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:27 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Deleted volume successfully. Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-6541476a-5b07-4490-b714-a4e9bd732244" acquired by "delete_volume" :: waited 0.023s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec8bc48-3542-4411-ab06-c59b42f95d52]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-2f39a144-3241-472a-bdae-01249eec335b tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-a13f74b2-b08f-496e-a37d-eda35cfc954e-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:27 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 Apr 15 23:26:27 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:27 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (e2067306-0a39-4b38-bf0f-84e7af7953ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f411c5-15ce-4573-b3de-13b5b62f6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85" returned: 0 in 0.791s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f411c5-15ce-4573-b3de-13b5b62f6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354382150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0790160d-a2d7-4e96-8dac-61af9e1dd758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:28Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c34061-b0ea-4e91-8f6a-f56cce0de615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c34061-b0ea-4e91-8f6a-f56cce0de615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e22c0c-a612-49bd-bb91-478b88760336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e22c0c-a612-49bd-bb91-478b88760336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0790160d-a2d7-4e96-8dac-61af9e1dd758', 'volume_name': 'volume-0790160d-a2d7-4e96-8dac-61af9e1dd758', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358bf4a8-401e-4cb8-9ad4-5272a875185f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358bf4a8-401e-4cb8-9ad4-5272a875185f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd25e5f-d4cb-4020-abab-1dfc0e75ada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:27 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume 0790160d-a2d7-4e96-8dac-61af9e1dd758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0790160d-a2d7-4e96-8dac-61af9e1dd758', 'volume_size': 1} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:27 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:27 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.info Apr 15 23:26:27 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:28 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244" returned: 0 in 0.671s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:28 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244 Apr 15 23:26:28 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:28 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.info" returned: 0 in 0.542s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:28 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.info is being set with open permissions: ugo+rw Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:28 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.info Apr 15 23:26:28 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:28 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6541476a-5b07-4490-b714-a4e9bd732244" returned: 0 in 0.469s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-6541476a-5b07-4490-b714-a4e9bd732244" released by "delete_volume" :: held 1.188s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Created reservations ['a7197504-3f86-4e91-b82e-6188031facef', 'e0bf8580-e7be-4f0a-8d29-fa52e476afad', 'db66bb81-ca3a-4124-a218-034cdcd97add', '9d47f1a0-1a16-4006-9ef6-59df4ba602f3'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:28 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:28 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:28 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.info" returned: 0 in 0.524s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.858s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.339s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663040672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5030c5-b2ce-4958-9621-bce79f887e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:26Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Creating volume 1f5030c5-b2ce-4958-9621-bce79f887e2d {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:28 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:28 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:28 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dee711c5-9dcf-4faf-aa36-21efd39a8ade tempest-VolumeDependencyTests-2019173142 None] Create snapshot completed successfully Apr 15 23:26:28 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d 1073741824 Apr 15 23:26:28 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:29 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:29 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Deleted volume successfully. Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-59d581b3-930f-4c17-9269-f0f128e79f6e tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-6541476a-5b07-4490-b714-a4e9bd732244-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:29 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d 1073741824" returned: 0 in 0.609s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:29 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d Apr 15 23:26:29 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (96c38d0b-6d65-4a78-965d-b1c067980e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040e3982-a72c-4bf4-91b2-49434a097d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040e3982-a72c-4bf4-91b2-49434a097d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766859875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645fd9e9-e625-43e4-a10b-17952ad34cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c579a8c167946b99d40faa745042c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fc73db56-03c7-4c8d-9a79-ea459f64de85,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:29Z,use_quota=True,user_id='e559e45143bb46ca953d07d48eec6647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78220288-2146-49be-810b-a99108a498b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78220288-2146-49be-810b-a99108a498b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27493cd-1c13-4682-a144-cae684748cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27493cd-1c13-4682-a144-cae684748cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '645fd9e9-e625-43e4-a10b-17952ad34cf1', 'volume_name': 'volume-645fd9e9-e625-43e4-a10b-17952ad34cf1', 'volume_size': 1, 'snapshot_id': 'fc73db56-03c7-4c8d-9a79-ea459f64de85'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f701bf-c7ba-4833-ba5c-402a7ddf87a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f701bf-c7ba-4833-ba5c-402a7ddf87a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8888f86-f0e4-49f5-a5b3-1a3546680d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:29 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Volume 645fd9e9-e625-43e4-a10b-17952ad34cf1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-645fd9e9-e625-43e4-a10b-17952ad34cf1', 'volume_size': 1, 'snapshot_id': 'fc73db56-03c7-4c8d-9a79-ea459f64de85'} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-2472f0f8-f1b6-4217-86a2-b1739d1520db-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-2472f0f8-f1b6-4217-86a2-b1739d1520db-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-quobyte-2472f0f8-f1b6-4217-86a2-b1739d1520db" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-2472f0f8-f1b6-4217-86a2-b1739d1520db" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b34c5-57e8-42ee-831d-b70a6b492b2e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:29 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db Apr 15 23:26:29 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:29 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d" returned: 0 in 0.564s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.352s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782680587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1fa746-71e2-4ad2-ba22-5f580f618d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:26Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Creating volume 7e1fa746-71e2-4ad2-ba22-5f580f618d05 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:29 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:29 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500a5e2e-0fc0-49b2-84a6-a34055eb05e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5030c5-b2ce-4958-9621-bce79f887e2d', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b653e24-3bd2-4542-a06a-7c47fd3a04a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:30 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 1073741824 Apr 15 23:26:30 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:30 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume volume-1f5030c5-b2ce-4958-9621-bce79f887e2d (1f5030c5-b2ce-4958-9621-bce79f887e2d): created successfully Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b653e24-3bd2-4542-a06a-7c47fd3a04a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (ca32f0e2-a591-4767-bec2-6a3cb46b88cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:30 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b803164c-8726-4e81-9cd1-f95846eb447a tempest-CreateVolumesFromSnapshotTest-832247679 None] Created volume successfully. Apr 15 23:26:30 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db" returned: 0 in 0.616s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:30 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db Apr 15 23:26:30 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:30 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 1073741824" returned: 0 in 0.591s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:30 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 Apr 15 23:26:30 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:30 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2472f0f8-f1b6-4217-86a2-b1739d1520db" returned: 0 in 0.503s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-2472f0f8-f1b6-4217-86a2-b1739d1520db" released by "delete_volume" :: held 1.155s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Created reservations ['43b62386-4c54-427d-8428-3033bde8746b', '7bfb6c58-209a-4950-8b3d-30682a2b77d6', 'f85c1b73-8497-4bed-b60a-a450133a7c9f', '9e058c4e-ebb6-4d64-b2ec-364c6f6a3d5e'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:30 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:30 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Flow 'volume_create_manager' (49a086dd-3183-4f45-8db1-60b0c4678633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d849c25-2ff2-4f5f-973a-900e3e6f226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d849c25-2ff2-4f5f-973a-900e3e6f226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-819265285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcc0b0d956b43678e2a7d0f0573eb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:31Z,use_quota=True,user_id='67e04bcb3a0e48c9b0b319138a542afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba709de-9c06-4578-b7a8-b5aae1614a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba709de-9c06-4578-b7a8-b5aae1614a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cd8ad5-64e7-429c-9a54-7b1f21a1811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cd8ad5-64e7-429c-9a54-7b1f21a1811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b', 'volume_name': 'volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ad0e68-c6ac-4997-bb97-84016a5aea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ad0e68-c6ac-4997-bb97-84016a5aea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0807ba4c-de19-4e05-93e3-f76de980e887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:30 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Volume 3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b', 'volume_size': 1} Apr 15 23:26:30 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:31 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05" returned: 0 in 0.427s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.065s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43211358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2094f948-aaf3-42c5-9303-02314a3e9035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:27Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Creating volume 2094f948-aaf3-42c5-9303-02314a3e9035 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:31 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedeac8d-d58e-4572-b3ad-e4891ad1b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d84467-b458-4d53-a19b-23f4369fd1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:31 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 1073741824 Apr 15 23:26:31 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:31 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 (7e1fa746-71e2-4ad2-ba22-5f580f618d05): created successfully Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d84467-b458-4d53-a19b-23f4369fd1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (ba69251d-7349-4cc7-896c-a15774153970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fccce5f3-e217-48c8-8318-21673217b486 tempest-CreateVolumesFromSnapshotTest-832247679 None] Created volume successfully. Apr 15 23:26:31 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.395s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:31 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Deleted volume successfully. Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-cc3b1380-a68a-4b8d-a9b8-f7cbbd8d4afd tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-2472f0f8-f1b6-4217-86a2-b1739d1520db-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:31 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 1073741824" returned: 0 in 0.478s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:31 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 Apr 15 23:26:31 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-6a992810-3865-499e-9a6a-5f8bf9abcc6f-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-6a992810-3865-499e-9a6a-5f8bf9abcc6f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "cinder-quobyte-6a992810-3865-499e-9a6a-5f8bf9abcc6f" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-6a992810-3865-499e-9a6a-5f8bf9abcc6f" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7fa8de-135b-4346-a7e8-642aed37b691]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:31 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f Apr 15 23:26:31 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:31 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.672s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789237158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2fab93-3f14-4c3d-ae2d-c549fd15493e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:27Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Creating volume ac2fab93-3f14-4c3d-ae2d-c549fd15493e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:31 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:31 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db838189-dfdd-496f-9159-389008d0633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2094f948-aaf3-42c5-9303-02314a3e9035', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064f6e26-c79c-40d9-b7b1-789d48c66fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:32 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e 1073741824 Apr 15 23:26:32 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:32 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume volume-2094f948-aaf3-42c5-9303-02314a3e9035 (2094f948-aaf3-42c5-9303-02314a3e9035): created successfully Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064f6e26-c79c-40d9-b7b1-789d48c66fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (91748a46-65d0-41d6-bd46-ea1ee35e5c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:32 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-4d7c4d99-588f-415b-8ff4-c5984a9049ab tempest-CreateVolumesFromSnapshotTest-832247679 None] Created volume successfully. Apr 15 23:26:32 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f" returned: 0 in 0.495s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:32 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f Apr 15 23:26:32 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:32 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e 1073741824" returned: 0 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:32 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e Apr 15 23:26:32 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:32 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-6a992810-3865-499e-9a6a-5f8bf9abcc6f" returned: 0 in 0.440s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-quobyte-6a992810-3865-499e-9a6a-5f8bf9abcc6f" released by "delete_volume" :: held 0.956s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Created reservations ['e7c7446a-4d00-483f-bc43-977f9af33161', 'f8d0171a-12a8-4330-b81f-8e730c4bc326', '818533ef-a248-46d1-8e3e-952cc103ed9f', 'c81597d5-a3d4-4db7-ba5a-b14198764ea1'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:32 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:32 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:32 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e" returned: 0 in 0.470s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.319s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354382150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0790160d-a2d7-4e96-8dac-61af9e1dd758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa39f002b54a4e7b93681752a924eb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:28Z,use_quota=True,user_id='87ddb25ebfc44e55820e22f3407f47e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Creating volume 0790160d-a2d7-4e96-8dac-61af9e1dd758 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:32 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:32 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c2a885-bdd4-4cac-a9f6-da052e064480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac20c6a-c5f3-431f-9e54-64ac111cc39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:33 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 1073741824 Apr 15 23:26:33 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:33 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e (ac2fab93-3f14-4c3d-ae2d-c549fd15493e): created successfully Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac20c6a-c5f3-431f-9e54-64ac111cc39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (b7b28e63-73ad-4c13-bb0d-950a93d5c0c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-50ce10ee-f6b5-4dfd-999a-e5b920052dbb tempest-CreateVolumesFromSnapshotTest-832247679 None] Created volume successfully. Apr 15 23:26:33 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:33 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Deleted volume successfully. Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d1b0907d-36bb-4866-8dac-5dadac649c05 tempest-CreateVolumesFromImageTest-1765559565 None] Lock "cinder-6a992810-3865-499e-9a6a-5f8bf9abcc6f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:33 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 1073741824" returned: 0 in 0.573s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:33 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:33 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 Apr 15 23:26:33 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:34 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.454s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-fc73db56-03c7-4c8d-9a79-ea459f64de85-645fd9e9-e625-43e4-a10b-17952ad34cf1" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd25e5f-d4cb-4020-abab-1dfc0e75ada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0790160d-a2d7-4e96-8dac-61af9e1dd758', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64eff5f-57c9-41d1-94b5-d8c85506d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:34 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Volume volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 (0790160d-a2d7-4e96-8dac-61af9e1dd758): created successfully Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64eff5f-57c9-41d1-94b5-d8c85506d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Flow 'volume_create_manager' (e2067306-0a39-4b38-bf0f-84e7af7953ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-fc73db56-03c7-4c8d-9a79-ea459f64de85-645fd9e9-e625-43e4-a10b-17952ad34cf1" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Creating volume 645fd9e9-e625-43e4-a10b-17952ad34cf1 from snapshot fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-645fd9e9-e625-43e4-a10b-17952ad34cf1" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:34 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fca8e270-88ee-43fb-82b9-299e449905d7 tempest-CreateVolumesFromSnapshotTest-832247679 None] Created volume successfully. Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-645fd9e9-e625-43e4-a10b-17952ad34cf1" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] snapshot: fc73db56-03c7-4c8d-9a79-ea459f64de85, volume: 645fd9e9-e625-43e4-a10b-17952ad34cf1, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[541575ff-b937-4264-a434-e77b031d4072]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-0790160d-a2d7-4e96-8dac-61af9e1dd758-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-0790160d-a2d7-4e96-8dac-61af9e1dd758-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-0790160d-a2d7-4e96-8dac-61af9e1dd758" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-0790160d-a2d7-4e96-8dac-61af9e1dd758" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9d6b20-ef29-4d7d-8688-5d70ff9447df]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:34 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 Apr 15 23:26:34 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:34 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 Apr 15 23:26:34 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Flow 'volume_create_manager' (147bc6ca-bb15-4a56-bb79-660b3b607cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def81d4b-ab04-4c83-9771-c6f6162b53c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def81d4b-ab04-4c83-9771-c6f6162b53c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4420c1e4-1fcb-4b24-950c-b6f0168ba8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe1bdb74664768a389ff4919110af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:35Z,use_quota=True,user_id='11bf292a20814e1eae3d7c07f46636ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81fa11a-abd4-4225-91e3-751b8acd9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81fa11a-abd4-4225-91e3-751b8acd9f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10abc202-6354-48cb-9687-318d8b4df231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10abc202-6354-48cb-9687-318d8b4df231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4420c1e4-1fcb-4b24-950c-b6f0168ba8d0', 'volume_name': 'volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af80f98-8302-4040-b714-94395b4e7b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af80f98-8302-4040-b714-94395b4e7b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b37684e-2397-4e86-9f36-bbcde14b88b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:34 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Volume 4420c1e4-1fcb-4b24-950c-b6f0168ba8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0', 'volume_size': 1} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:34 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85" returned: 0 in 0.561s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd95f0e-4b97-4266-8592-7453cf497e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931107f-7146-4d62-bd0f-acb3bf07cd1b]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:34 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d Apr 15 23:26:34 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:34 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758" returned: 0 in 0.546s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:34 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:34 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758 Apr 15 23:26:34 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:35 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d" returned: 0 in 0.477s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:35 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0790160d-a2d7-4e96-8dac-61af9e1dd758" returned: 0 in 0.415s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-0790160d-a2d7-4e96-8dac-61af9e1dd758" released by "delete_volume" :: held 0.985s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:35 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 Apr 15 23:26:35 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Created reservations ['7c0893e6-2268-4ab2-981b-b3a0c307ba06', 'a65fa6a1-0b35-47fb-ba45-9b376e6ec438', '20333b67-c50a-4fdf-86b7-97099fad9b78', '13acbc12-4525-4e40-9b19-5db919c84431'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:35 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:35 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:35 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.592s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:35 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Deleted volume successfully. Apr 15 23:26:35 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-88fa866f-0d34-4177-ace2-a9f43265e0ec tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-0790160d-a2d7-4e96-8dac-61af9e1dd758-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-ac2fab93-3f14-4c3d-ae2d-c549fd15493e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-ac2fab93-3f14-4c3d-ae2d-c549fd15493e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-ac2fab93-3f14-4c3d-ae2d-c549fd15493e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:36 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-ac2fab93-3f14-4c3d-ae2d-c549fd15493e" acquired by "delete_volume" :: waited 0.028s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:36 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7b2d1c-d9df-493a-a954-10d543692c5e]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:36 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:36 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e Apr 15 23:26:36 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:37 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1" returned: 0 in 2.167s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[21202492-f5e3-4d16-9499-60873214e4ed]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:37 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d Apr 15 23:26:37 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:37 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e" returned: 0 in 0.893s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:37 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e Apr 15 23:26:37 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:37 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d" returned: 0 in 0.586s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:26:37 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Converted 1024.00 MB image at 472.19 MB/s Apr 15 23:26:37 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 is being set with open permissions: ugo+rw Apr 15 23:26:37 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:37 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 Apr 15 23:26:38 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:38 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-ac2fab93-3f14-4c3d-ae2d-c549fd15493e" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-ac2fab93-3f14-4c3d-ae2d-c549fd15493e" released by "delete_volume" :: held 1.361s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Created reservations ['51338377-2ab5-4952-a6e2-4b1564a9f902', '5e3fc9e2-c5bc-4759-b992-1abd63cc6064', '95df3589-0e81-462c-ad8a-3bce3e4e390d', '52020a33-dd0b-4b3b-a553-bba14515d84b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:38 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:38 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:38 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1" returned: 0 in 0.422s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-645fd9e9-e625-43e4-a10b-17952ad34cf1" released by "_copy_volume_from_snapshot" :: held 4.287s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-fc73db56-03c7-4c8d-9a79-ea459f64de85-645fd9e9-e625-43e4-a10b-17952ad34cf1" released by "_create_volume_from_snapshot" :: held 4.315s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.358s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.466s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-819265285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcc0b0d956b43678e2a7d0f0573eb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:31Z,use_quota=True,user_id='67e04bcb3a0e48c9b0b319138a542afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Creating volume 3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:38 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:38 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b 1073741824 Apr 15 23:26:38 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8888f86-f0e4-49f5-a5b3-1a3546680d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645fd9e9-e625-43e4-a10b-17952ad34cf1', 'volume_size': 1, 'snapshot_id': 'fc73db56-03c7-4c8d-9a79-ea459f64de85'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6c55dc-98c6-404e-a42c-c5104d90e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:38 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Volume volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 (645fd9e9-e625-43e4-a10b-17952ad34cf1): created successfully Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6c55dc-98c6-404e-a42c-c5104d90e1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (96c38d0b-6d65-4a78-965d-b1c067980e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-c42ade88-0007-4a08-991f-ec9bfc1c43f3 tempest-VolumeDependencyTests-2019173142 None] Created volume successfully. Apr 15 23:26:38 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.429s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:38 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Deleted volume successfully. Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-35edabd3-d56d-4234-bb89-5cb331c89527 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-ac2fab93-3f14-4c3d-ae2d-c549fd15493e-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-2094f948-aaf3-42c5-9303-02314a3e9035-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-2094f948-aaf3-42c5-9303-02314a3e9035-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-2094f948-aaf3-42c5-9303-02314a3e9035" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-2094f948-aaf3-42c5-9303-02314a3e9035" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[07567937-6580-4750-b0d0-b6fb5f8b4209]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:38 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 Apr 15 23:26:38 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:38 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b 1073741824" returned: 0 in 0.529s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:38 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:39 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b Apr 15 23:26:39 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-fc73db56-03c7-4c8d-9a79-ea459f64de85-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-fc73db56-03c7-4c8d-9a79-ea459f64de85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-4bd95f0e-4b97-4266-8592-7453cf497e6d" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-4bd95f0e-4b97-4266-8592-7453cf497e6d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-fc73db56-03c7-4c8d-9a79-ea459f64de85" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-fc73db56-03c7-4c8d-9a79-ea459f64de85" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Deleting offline snapshot fc73db56-03c7-4c8d-9a79-ea459f64de85 of volume 4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] snapshot_file for this snap is: volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ebdc4-45b3-4b93-b652-e15aef7d2786]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:39 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 Apr 15 23:26:39 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:39 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035" returned: 0 in 0.580s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:39 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035 Apr 15 23:26:39 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:39 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.851s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4420c1e4-1fcb-4b24-950c-b6f0168ba8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe1bdb74664768a389ff4919110af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:35Z,use_quota=True,user_id='11bf292a20814e1eae3d7c07f46636ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Creating volume 4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:39 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0807ba4c-de19-4e05-93e3-f76de980e887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ea61d2-e101-4773-b45e-5566b254daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:39 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 1073741824 Apr 15 23:26:39 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:39 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Volume volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b (3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b): created successfully Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ea61d2-e101-4773-b45e-5566b254daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Flow 'volume_create_manager' (49a086dd-3183-4f45-8db1-60b0c4678633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:39 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-41e4f76d-5c84-4d83-8b22-7449e9501c56 tempest-SnapshotDependencyTests-49229950 None] Created volume successfully. Apr 15 23:26:39 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85" returned: 0 in 0.523s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd95f0e-4b97-4266-8592-7453cf497e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a0a65b-b64e-429d-96f6-739c91b88cb9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:39 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-2094f948-aaf3-42c5-9303-02314a3e9035" returned: 0 in 0.438s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-2094f948-aaf3-42c5-9303-02314a3e9035" released by "delete_volume" :: held 1.060s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:39 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d Apr 15 23:26:39 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Created reservations ['eedf43d9-3ced-4ed1-9799-d4e8c2fc1310', '6a0a2c88-e247-4a4e-9e33-f9dc290aa7f2', '954dd924-c14b-4805-9a01-68501d45833a', '0209ee34-3cfe-4a2a-9df0-84f8c06884c6'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:39 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:39 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:39 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:40 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 1073741824" returned: 0 in 0.617s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:40 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 Apr 15 23:26:40 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:40 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d" returned: 0 in 0.563s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:40 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 Apr 15 23:26:40 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:40 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.468s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Deleted volume successfully. Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-dc621e89-df1b-4e15-add9-a6b6edaaba58 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-2094f948-aaf3-42c5-9303-02314a3e9035-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:40 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0" returned: 0 in 0.457s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b37684e-2397-4e86-9f36-bbcde14b88b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ad4b0d-616d-4b46-8c19-9798c9cb2737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:40 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Volume volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 (4420c1e4-1fcb-4b24-950c-b6f0168ba8d0): created successfully Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ad4b0d-616d-4b46-8c19-9798c9cb2737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Flow 'volume_create_manager' (147bc6ca-bb15-4a56-bb79-660b3b607cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:40 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d97f6cb6-53e8-45b8-866c-046e266004c4 tempest-CinderUnicodeTest-1027587696 None] Created volume successfully. Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Creating offline snapshot 82de5785-4652-4f7a-813b-5397c999d7c1 of volume 3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac84de1-21b4-4ebc-bbf1-eaa5387cdf50]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:40 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b Apr 15 23:26:40 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:40 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85" returned: 0 in 0.489s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:40 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85 Apr 15 23:26:40 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-7e1fa746-71e2-4ad2-ba22-5f580f618d05-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-7e1fa746-71e2-4ad2-ba22-5f580f618d05-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:40 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-7e1fa746-71e2-4ad2-ba22-5f580f618d05" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-7e1fa746-71e2-4ad2-ba22-5f580f618d05" acquired by "delete_volume" :: waited 0.027s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a621d-76e7-4e46-81b5-a26b122209be]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:41 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 Apr 15 23:26:41 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:41 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" returned: 0 in 0.524s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:41 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 1G Apr 15 23:26:41 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Flow 'volume_create_manager' (da31383a-f773-48a2-a362-e1461169c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08630bff-f2b9-4bc6-82b7-d7c1ae35a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08630bff-f2b9-4bc6-82b7-d7c1ae35a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-819029109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46480a0d-9bac-4080-9051-a0f6b290800e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe1bdb74664768a389ff4919110af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:41Z,use_quota=True,user_id='11bf292a20814e1eae3d7c07f46636ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d2a194-3361-46b0-b676-2b79959c1651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d2a194-3361-46b0-b676-2b79959c1651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af99ff6e-433f-487a-aada-b067cd7fa772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af99ff6e-433f-487a-aada-b067cd7fa772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46480a0d-9bac-4080-9051-a0f6b290800e', 'volume_name': 'volume-46480a0d-9bac-4080-9051-a0f6b290800e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce26925-8eb4-4528-9e0b-e7f77aaacd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce26925-8eb4-4528-9e0b-e7f77aaacd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:41 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd19299e-7df8-45d9-8cb3-4d2ad094bfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:41 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Volume 46480a0d-9bac-4080-9051-a0f6b290800e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46480a0d-9bac-4080-9051-a0f6b290800e', 'volume_size': 1} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d.fc73db56-03c7-4c8d-9a79-ea459f64de85" returned: 0 in 0.506s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-fc73db56-03c7-4c8d-9a79-ea459f64de85" released by "_delete_snapshot" :: held 2.139s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-4bd95f0e-4b97-4266-8592-7453cf497e6d" released by "delete_snapshot" :: held 2.150s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Created reservations ['1aedc3e4-ba6b-4790-b71d-b9e7b3b572f7', '93c25342-b693-4ff2-94a4-29c85eb4b7b0', '2ad0aa1c-5ddc-478b-81e1-a4ab722f269c', 'dc012d6e-7089-4e39-a38b-1491d68a18d9'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:41 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Delete snapshot completed successfully. Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-987f381d-8c9d-408d-98b1-4eff0fc1cbbc tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-fc73db56-03c7-4c8d-9a79-ea459f64de85-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:41 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05" returned: 0 in 0.572s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:41 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05 Apr 15 23:26:41 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:41 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 1G" returned: 0 in 0.478s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:41 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:41 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 Apr 15 23:26:41 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:42 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7e1fa746-71e2-4ad2-ba22-5f580f618d05" returned: 0 in 0.471s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-7e1fa746-71e2-4ad2-ba22-5f580f618d05" released by "delete_volume" :: held 1.070s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Created reservations ['0c820d8f-21e3-487b-aeae-8a798b0bf4e1', '616bf0ad-1426-482e-9a74-0219721dd291', '9b6a8cf1-744f-4c0f-9e9a-9712d818ed18', '725c1528-75a7-42a7-aa18-44f2d5eae313'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:42 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1" returned: 0 in 0.434s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:42 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 is being set with open permissions: ugo+rw Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:42 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 Apr 15 23:26:42 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:42 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:42 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-4bd95f0e-4b97-4266-8592-7453cf497e6d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-4bd95f0e-4b97-4266-8592-7453cf497e6d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-4bd95f0e-4b97-4266-8592-7453cf497e6d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-4bd95f0e-4b97-4266-8592-7453cf497e6d" acquired by "delete_volume" :: waited 0.014s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6836fe-d2aa-4af5-a87f-6c585d10377a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:42 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d Apr 15 23:26:42 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:42 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1" returned: 0 in 0.429s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:42 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:42 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Deleted volume successfully. Apr 15 23:26:42 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.info Apr 15 23:26:42 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-af5694fe-f7e0-42b0-a077-2005f59809b6 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-7e1fa746-71e2-4ad2-ba22-5f580f618d05-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:42 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d" returned: 0 in 0.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:42 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d Apr 15 23:26:42 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:42 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.info" returned: 0 in 0.423s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:42 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.info is being set with open permissions: ugo+rw Apr 15 23:26:42 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:43 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.info Apr 15 23:26:43 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-1f5030c5-b2ce-4958-9621-bce79f887e2d-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-1f5030c5-b2ce-4958-9621-bce79f887e2d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-1f5030c5-b2ce-4958-9621-bce79f887e2d" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-1f5030c5-b2ce-4958-9621-bce79f887e2d" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed00780b-2692-4dd4-b3f4-d5b47ee94219]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:43 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d Apr 15 23:26:43 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:43 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4bd95f0e-4b97-4266-8592-7453cf497e6d" returned: 0 in 0.414s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-4bd95f0e-4b97-4266-8592-7453cf497e6d" released by "delete_volume" :: held 0.911s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Created reservations ['ff45be29-2300-4e4e-bf6a-f2e3acbf61a3', '7354b4fc-3b14-4fde-82cc-6a867d01e157', '41817cc7-0bce-47ee-8846-c925dd7f795e', '652d8149-2c87-4920-9a09-415d76d5e1a7'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:43 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:43 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:43 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.info" returned: 0 in 0.424s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-819029109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46480a0d-9bac-4080-9051-a0f6b290800e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebe1bdb74664768a389ff4919110af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:41Z,use_quota=True,user_id='11bf292a20814e1eae3d7c07f46636ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Creating volume 46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:43 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:43 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-72cb84fa-f32c-4bb6-9ca1-968032f1a287 tempest-SnapshotDependencyTests-49229950 None] Create snapshot completed successfully Apr 15 23:26:43 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e 1073741824 Apr 15 23:26:43 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (e5947cac-5fb9-45fb-bc20-5b448f9133c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597e5916-5043-4773-a081-33763bce3afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:43 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597e5916-5043-4773-a081-33763bce3afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1523773493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9663ccc-a9bd-40d4-aeb6-f018dd1079ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c579a8c167946b99d40faa745042c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:44Z,use_quota=True,user_id='e559e45143bb46ca953d07d48eec6647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dcd2c7-9df0-464f-b33e-0119a35d8901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dcd2c7-9df0-464f-b33e-0119a35d8901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7b6b15-7094-45be-a936-2daaa37ca047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7b6b15-7094-45be-a936-2daaa37ca047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9663ccc-a9bd-40d4-aeb6-f018dd1079ed', 'volume_name': 'volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080191b4-8a7a-4e69-ac24-cfca33686482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080191b4-8a7a-4e69-ac24-cfca33686482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949b67c5-d198-4c49-ace3-e4cc07c3ee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:43 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Volume f9663ccc-a9bd-40d4-aeb6-f018dd1079ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed', 'volume_size': 1} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d" returned: 0 in 0.628s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:43 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:43 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.462s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:43 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Deleted volume successfully. Apr 15 23:26:43 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:43 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-da8b9684-2467-4c28-beba-8a0abc6dfe54 tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-4bd95f0e-4b97-4266-8592-7453cf497e6d-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:44 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e 1073741824" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:44 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e Apr 15 23:26:44 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Flow 'volume_create_manager' (6da5bc76-fc85-497d-b527-6d755fb3faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e35b4cf-7234-4dfd-9d1d-c631fda59856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e35b4cf-7234-4dfd-9d1d-c631fda59856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d06c16-d19a-4172-a869-cb453c44dd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bcc0b0d956b43678e2a7d0f0573eb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82de5785-4652-4f7a-813b-5397c999d7c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:44Z,use_quota=True,user_id='67e04bcb3a0e48c9b0b319138a542afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f0e41-c6ce-4f99-9a5e-86a1d8987e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f0e41-c6ce-4f99-9a5e-86a1d8987e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7437da29-1bae-4257-a8d4-9d0b52d94cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7437da29-1bae-4257-a8d4-9d0b52d94cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6d06c16-d19a-4172-a869-cb453c44dd5e', 'volume_name': 'volume-f6d06c16-d19a-4172-a869-cb453c44dd5e', 'volume_size': 1, 'snapshot_id': '82de5785-4652-4f7a-813b-5397c999d7c1'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a3d62f-ab8e-4d4e-90e0-ebec3e6a9019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a3d62f-ab8e-4d4e-90e0-ebec3e6a9019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7097628-8acd-4b18-a806-9e51c9d913d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:44 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Volume f6d06c16-d19a-4172-a869-cb453c44dd5e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6d06c16-d19a-4172-a869-cb453c44dd5e', 'volume_size': 1, 'snapshot_id': '82de5785-4652-4f7a-813b-5397c999d7c1'} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:44 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-1f5030c5-b2ce-4958-9621-bce79f887e2d" returned: 0 in 0.455s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-1f5030c5-b2ce-4958-9621-bce79f887e2d" released by "delete_volume" :: held 1.110s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Created reservations ['aff0faf0-5b03-4e27-b77f-5d0829dfe5ac', 'f9123cbf-ba0a-4dc1-9a4a-59a5d7bb552e', '2cc8df3f-95e7-4676-8f9f-e34305ce2ec1', 'c43463bb-74bf-4395-88fd-31904ffcc02c'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:44 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:44 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:44 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e" returned: 0 in 0.476s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1523773493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9663ccc-a9bd-40d4-aeb6-f018dd1079ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c579a8c167946b99d40faa745042c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:44Z,use_quota=True,user_id='e559e45143bb46ca953d07d48eec6647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Creating volume f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:44 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd19299e-7df8-45d9-8cb3-4d2ad094bfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46480a0d-9bac-4080-9051-a0f6b290800e', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a1076b-6b59-4c24-8bd3-640b959ce8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:44 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed 1073741824 Apr 15 23:26:44 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:44 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Volume volume-46480a0d-9bac-4080-9051-a0f6b290800e (46480a0d-9bac-4080-9051-a0f6b290800e): created successfully Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a1076b-6b59-4c24-8bd3-640b959ce8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Flow 'volume_create_manager' (da31383a-f773-48a2-a362-e1461169c73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a433e504-852f-4fc5-bd1e-676ecc60381c tempest-CinderUnicodeTest-1027587696 None] Created volume successfully. Apr 15 23:26:44 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.395s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:44 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Deleted volume successfully. Apr 15 23:26:44 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-25b548c3-72f7-47c2-821d-46e2e6b5708c tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-1f5030c5-b2ce-4958-9621-bce79f887e2d-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:45 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed 1073741824" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:45 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed Apr 15 23:26:45 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-da5f7893-0c32-4149-889e-8e3c80759398-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-da5f7893-0c32-4149-889e-8e3c80759398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-da5f7893-0c32-4149-889e-8e3c80759398" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-da5f7893-0c32-4149-889e-8e3c80759398" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Deleting offline snapshot da5f7893-0c32-4149-889e-8e3c80759398 of volume 7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] snapshot_file for this snap is: volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[006b95b5-de18-481f-b687-71ddcbe08128]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:45 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 Apr 15 23:26:45 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:45 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" returned: 0 in 0.446s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.257s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-quobyte-82de5785-4652-4f7a-813b-5397c999d7c1-f6d06c16-d19a-4172-a869-cb453c44dd5e" by "_create_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949b67c5-d198-4c49-ace3-e4cc07c3ee29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aba7f41-c285-457f-997b-a7501241dd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-82de5785-4652-4f7a-813b-5397c999d7c1-f6d06c16-d19a-4172-a869-cb453c44dd5e" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Creating volume f6d06c16-d19a-4172-a869-cb453c44dd5e from snapshot 82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-quobyte-f6d06c16-d19a-4172-a869-cb453c44dd5e" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:45 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Volume volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed (f9663ccc-a9bd-40d4-aeb6-f018dd1079ed): created successfully Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aba7f41-c285-457f-997b-a7501241dd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (e5947cac-5fb9-45fb-bc20-5b448f9133c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-f6d06c16-d19a-4172-a869-cb453c44dd5e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] snapshot: 82de5785-4652-4f7a-813b-5397c999d7c1, volume: f6d06c16-d19a-4172-a869-cb453c44dd5e, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:45 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d0333711-9b2f-46f8-bdba-534cf130c571 tempest-VolumeDependencyTests-2019173142 None] Created volume successfully. Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea28353d-04f1-44bb-b2e2-41c4c7b50e98]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:45 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 Apr 15 23:26:45 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:45 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398" returned: 0 in 0.532s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d8d2dd-3aef-4cd4-9b78-fbce68800fc4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:45 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:46 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 Apr 15 23:26:46 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (020d256a-551b-4215-b26c-4934cec84aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faac1eba-c532-485c-945f-544725ee6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faac1eba-c532-485c-945f-544725ee6925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-186569166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8340282d-910f-48aa-91ca-c41d6710f962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c579a8c167946b99d40faa745042c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f9663ccc-a9bd-40d4-aeb6-f018dd1079ed,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:46Z,use_quota=True,user_id='e559e45143bb46ca953d07d48eec6647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869fba6b-2c13-4975-85c6-9d0c6ad6fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:46 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869fba6b-2c13-4975-85c6-9d0c6ad6fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7197d224-4c14-4577-9365-d411157bfe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1" returned: 0 in 0.575s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9bfdee-21c1-47ad-8a2d-f997bcfcc3e9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7197d224-4c14-4577-9365-d411157bfe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8340282d-910f-48aa-91ca-c41d6710f962', 'volume_name': 'volume-8340282d-910f-48aa-91ca-c41d6710f962', 'volume_size': 1, 'source_volid': 'f9663ccc-a9bd-40d4-aeb6-f018dd1079ed', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069542f4-52a0-4120-9a86-d127ff315c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069542f4-52a0-4120-9a86-d127ff315c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbbe95e-76a8-4918-a30f-4d15ef9b7151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:46 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Volume 8340282d-910f-48aa-91ca-c41d6710f962: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8340282d-910f-48aa-91ca-c41d6710f962', 'volume_size': 1, 'source_volid': 'f9663ccc-a9bd-40d4-aeb6-f018dd1079ed', 'source_volstatus': 'available'} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:46 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b Apr 15 23:26:46 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:46 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" returned: 0 in 0.548s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:46 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 Apr 15 23:26:46 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:46 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" returned: 0 in 0.500s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:46 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e Apr 15 23:26:46 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:46 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398" returned: 0 in 0.463s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:46 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:46 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398 Apr 15 23:26:46 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:48 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1.da5f7893-0c32-4149-889e-8e3c80759398" returned: 0 in 1.448s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-da5f7893-0c32-4149-889e-8e3c80759398" released by "_delete_snapshot" :: held 3.114s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" released by "delete_snapshot" :: held 3.130s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Created reservations ['d40e405e-d236-40a1-88e6-462947cb16d3', '0388a70a-94b5-40f9-939c-860351a0d526', '69edf1c9-8a0d-4973-a9f2-1fff978dc99c', '1eff1a6e-f8e9-4a95-8434-70a74f390f6b'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:48 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Delete snapshot completed successfully. Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8fe2f12e-00cf-4cfa-b1cf-b3d9b55958db tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-da5f7893-0c32-4149-889e-8e3c80759398-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:48 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e" returned: 0 in 2.164s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d341e213-28d0-4d8e-a75b-5419838d64bd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:48 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:48 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b Apr 15 23:26:48 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:49 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" returned: 0 in 0.578s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:26:49 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Converted 1024.00 MB image at 472.97 MB/s Apr 15 23:26:49 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e is being set with open permissions: ugo+rw Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:49 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e Apr 15 23:26:49 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "cinder-quobyte-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae808d4-1d96-4598-877c-a5e3ceb9c9c6]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:49 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 Apr 15 23:26:49 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:49 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e" returned: 0 in 0.431s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-f6d06c16-d19a-4172-a869-cb453c44dd5e" released by "_copy_volume_from_snapshot" :: held 4.309s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-82de5785-4652-4f7a-813b-5397c999d7c1-f6d06c16-d19a-4172-a869-cb453c44dd5e" released by "_create_volume_from_snapshot" :: held 4.337s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.359s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.162s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Creating offline snapshot 379bd87c-489d-4bc5-844a-6593060610d5 of volume 46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7097628-8acd-4b18-a806-9e51c9d913d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d06c16-d19a-4172-a869-cb453c44dd5e', 'volume_size': 1, 'snapshot_id': '82de5785-4652-4f7a-813b-5397c999d7c1'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6875cf84-d76c-42fc-85b1-a3996c33ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01afd7d-fe0c-4358-a91f-9112425c27fe]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:49 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Volume volume-f6d06c16-d19a-4172-a869-cb453c44dd5e (f6d06c16-d19a-4172-a869-cb453c44dd5e): created successfully Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6875cf84-d76c-42fc-85b1-a3996c33ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:49 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Flow 'volume_create_manager' (6da5bc76-fc85-497d-b527-6d755fb3faff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:49 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-9e9addcb-33cd-4292-83be-539ba86dbc10 tempest-SnapshotDependencyTests-49229950 None] Created volume successfully. Apr 15 23:26:49 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e Apr 15 23:26:49 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:50 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" returned: 0 in 0.574s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:50 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1 Apr 15 23:26:50 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:50 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e" returned: 0 in 0.498s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:50 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 1G Apr 15 23:26:50 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-82de5785-4652-4f7a-813b-5397c999d7c1-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-82de5785-4652-4f7a-813b-5397c999d7c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-quobyte-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-quobyte-82de5785-4652-4f7a-813b-5397c999d7c1" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-82de5785-4652-4f7a-813b-5397c999d7c1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Deleting offline snapshot 82de5785-4652-4f7a-813b-5397c999d7c1 of volume 3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] snapshot_file for this snap is: volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897a3ac-ae14-4d37-b3a2-ff8da5634345]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:50 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" returned: 0 in 0.513s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-quobyte-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1" released by "delete_volume" :: held 1.131s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Created reservations ['6e84b501-e164-464c-aa03-83b007000a5a', 'f65de449-5053-4d1e-aa82-5bf5f2194cde', '5528e95f-a2ea-435b-8b43-fde73a0b2b3c', 'f2c9d6df-cabe-4910-ae39-28ec178c49a0'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:50 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 Apr 15 23:26:50 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:50 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:50 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:50 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 1G" returned: 0 in 0.539s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:50 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46480a0d-9bac-4080-9051-a0f6b290800e -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:50 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46480a0d-9bac-4080-9051-a0f6b290800e -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 Apr 15 23:26:50 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:51 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1" returned: 0 in 0.541s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2af571-5552-474e-99ff-53b828baa432]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:51 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:51 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Deleted volume successfully. Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ba470e04-50a5-49c1-b8bd-cac7346b8e88 tempest-CreateVolumesFromSnapshotTest-832247679 None] Lock "cinder-7fe0a2ec-1bb6-45a2-81b4-e281e3285db1-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:51 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b Apr 15 23:26:51 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:51 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46480a0d-9bac-4080-9051-a0f6b290800e -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5" returned: 0 in 0.442s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:51 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 is being set with open permissions: ugo+rw Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:51 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 Apr 15 23:26:51 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:51 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" returned: 0 in 0.555s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:51 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 Apr 15 23:26:51 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:51 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5" returned: 0 in 0.449s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:51 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:51 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.info Apr 15 23:26:51 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:52 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1" returned: 0 in 0.541s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:52 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:52 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1 Apr 15 23:26:52 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.info" returned: 0 in 0.509s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:52 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.info is being set with open permissions: ugo+rw Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:52 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.info Apr 15 23:26:52 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:52 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b.82de5785-4652-4f7a-813b-5397c999d7c1" returned: 0 in 0.511s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:52 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-82de5785-4652-4f7a-813b-5397c999d7c1" released by "_delete_snapshot" :: held 2.230s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.info" returned: 0 in 0.531s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.055s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" released by "delete_snapshot" :: held 2.260s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.717s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:52 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Cloning volume f9663ccc-a9bd-40d4-aeb6-f018dd1079ed to volume 8340282d-910f-48aa-91ca-c41d6710f962 Apr 15 23:26:52 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6ef5ad81-3f85-4527-a869-56688c9faf9e tempest-CinderUnicodeTest-1027587696 None] Create snapshot completed successfully Apr 15 23:26:52 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Creating offline snapshot ae1e8b79-b28d-40f1-ae1e-57087e0a92aa of volume f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c921618-57f8-42a9-bd50-50c10830f401]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Created reservations ['50d9270e-c247-49f8-8d2b-dd91174818c5', '15c95c11-b7ca-42e6-8994-576dc7a97c1b', '9406b646-e98f-4b06-a2ce-1d6ac44e42de', 'd2de9a44-4cd3-44f9-9d84-b7f1863d7971'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:53 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Delete snapshot completed successfully. Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-5273411f-cfef-43c6-b8b0-c4f08afe6939 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-82de5785-4652-4f7a-813b-5397c999d7c1-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:53 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed Apr 15 23:26:53 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (dbb81225-7df6-48b5-be5c-466c589402c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab56c7c-a5af-4cc3-b05b-d901b380cc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab56c7c-a5af-4cc3-b05b-d901b380cc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1452738317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:53Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a8bb90-bb8e-40d8-924b-5663d2b33eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a8bb90-bb8e-40d8-924b-5663d2b33eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900af104-690d-423b-afa0-9e368954510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900af104-690d-423b-afa0-9e368954510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49', 'volume_name': 'volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f544243-55d9-4083-a95f-bc4113b719d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f544243-55d9-4083-a95f-bc4113b719d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666d58ac-fa87-4393-994b-eac6ef187fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:26:53 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume 0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49', 'volume_size': 1} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:53 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" returned: 0 in 0.559s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa 1G {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:53 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa 1G Apr 15 23:26:53 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-quobyte-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3b0c62-e3a3-4667-94ba-47fa437f6b9a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:53 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:53 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b Apr 15 23:26:53 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "cinder-379bd87c-489d-4bc5-844a-6593060610d5-delete_snapshot" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-379bd87c-489d-4bc5-844a-6593060610d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "cinder-quobyte-46480a0d-9bac-4080-9051-a0f6b290800e" by "delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-46480a0d-9bac-4080-9051-a0f6b290800e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "cinder-quobyte-379bd87c-489d-4bc5-844a-6593060610d5" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-379bd87c-489d-4bc5-844a-6593060610d5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Deleting offline snapshot 379bd87c-489d-4bc5-844a-6593060610d5 of volume 46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] snapshot_file for this snap is: volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e7bc23-bb80-4995-af5f-902ddb3b25a9]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:54 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa 1G" returned: 0 in 0.534s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:54 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa Apr 15 23:26:54 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:54 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 Apr 15 23:26:54 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:54 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" returned: 0 in 0.504s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:54 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b Apr 15 23:26:54 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:54 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5" returned: 0 in 0.511s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46480a0d-9bac-4080-9051-a0f6b290800e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:26:54 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed -F qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" returned: 0 in 0.501s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:54 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa is being set with open permissions: ugo+rw Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4552b6e-0df5-429b-9347-bd9b3ee3946c]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:54 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa Apr 15 23:26:54 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:54 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e Apr 15 23:26:54 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:54 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" returned: 0 in 0.453s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b" released by "delete_volume" :: held 0.988s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Created reservations ['183848c6-18ad-4606-bafe-c505e53b3da7', 'e4d75563-382e-4dd6-bcae-d154af0f8a43', '4b263b49-3561-42d0-802d-760430e12447', 'a215cd73-db19-4306-a7c6-83ee3fe5e510'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:54 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:54 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:54 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:55 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" returned: 0 in 0.415s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:55 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.info Apr 15 23:26:55 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:55 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e" returned: 0 in 0.509s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:55 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 Apr 15 23:26:55 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:55 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.444s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:55 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Deleted volume successfully. Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d350ad7f-0de5-4dc6-ba70-848286dfac3c tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-3c4fcd0e-e17d-4bf0-afc0-bb7f7db8db2b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:55 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.info" returned: 0 in 0.446s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:55 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.info is being set with open permissions: ugo+rw Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.info {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:55 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.info Apr 15 23:26:55 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:55 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5" returned: 0 in 0.510s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:55 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5 Apr 15 23:26:55 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:55 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.info" returned: 0 in 0.417s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-8340282d-910f-48aa-91ca-c41d6710f962" by "_copy_volume_from_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-8340282d-910f-48aa-91ca-c41d6710f962" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] snapshot: ae1e8b79-b28d-40f1-ae1e-57087e0a92aa, volume: 8340282d-910f-48aa-91ca-c41d6710f962, {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d45fa9-fb79-43b7-b518-be1f2b4106ed]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:55 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-f6d06c16-d19a-4172-a869-cb453c44dd5e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-f6d06c16-d19a-4172-a869-cb453c44dd5e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:56 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa Apr 15 23:26:56 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "cinder-quobyte-f6d06c16-d19a-4172-a869-cb453c44dd5e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-f6d06c16-d19a-4172-a869-cb453c44dd5e" acquired by "delete_volume" :: waited 0.020s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[5501c304-8b16-429e-ad5b-0b9210f469fd]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:56 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e.379bd87c-489d-4bc5-844a-6593060610d5" returned: 0 in 0.456s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-379bd87c-489d-4bc5-844a-6593060610d5" released by "_delete_snapshot" :: held 2.055s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-46480a0d-9bac-4080-9051-a0f6b290800e" released by "delete_snapshot" :: held 2.066s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:56 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e Apr 15 23:26:56 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Created reservations ['c82f3558-d002-46c1-a0bb-c20637b53913', '7a809fdf-d575-431f-8ee2-c91d8d0b9a6a', '85d10582-f219-47bd-bf11-0690777a4d12', '26af8572-e6d3-4f80-930d-00c611f32513'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:56 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Delete snapshot completed successfully. Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-bb28ae1e-bf8e-41db-9788-b8cd9895323b tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-379bd87c-489d-4bc5-844a-6593060610d5-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:56 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" returned: 0 in 0.533s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Creating direct copy from snapshot {{(pid=82388) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e42095-bc78-444b-a988-97887b98ad43]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:56 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:56 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed Apr 15 23:26:56 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:56 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e Apr 15 23:26:56 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:56 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" returned: 0 in 0.496s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG cinder.utils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Path /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 not found in is_blk_device check {{(pid=82388) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 23:26:56 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:57 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f6d06c16-d19a-4172-a869-cb453c44dd5e" returned: 0 in 0.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:57 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 Apr 15 23:26:57 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-quobyte-f6d06c16-d19a-4172-a869-cb453c44dd5e" released by "delete_volume" :: held 0.964s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Created reservations ['1508ec95-63b0-43ed-87d0-0abbbb934cf7', '40ce7419-958b-40f4-9569-c403ad21375a', '58406db2-822d-449b-b9ec-4cb07199d5da', '0b9b30d6-939b-495d-8a43-92b9570661b9'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:57 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:57 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "cinder-46480a0d-9bac-4080-9051-a0f6b290800e-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-46480a0d-9bac-4080-9051-a0f6b290800e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "cinder-quobyte-46480a0d-9bac-4080-9051-a0f6b290800e" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-46480a0d-9bac-4080-9051-a0f6b290800e" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1ecbd-b742-441b-975e-da89b8cac212]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:57 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e Apr 15 23:26:57 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:57 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.577s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:26:57 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Deleted volume successfully. Apr 15 23:26:57 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ee7a2a2e-bb74-4b3f-b438-de37d5dc7ca3 tempest-SnapshotDependencyTests-49229950 None] Lock "cinder-f6d06c16-d19a-4172-a869-cb453c44dd5e-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:58 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e" returned: 0 in 1.453s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:58 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:58 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e Apr 15 23:26:58 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:59 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962" returned: 0 in 2.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[02963d4e-84a2-462e-a00b-5d63a3c34bd1]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:59 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed Apr 15 23:26:59 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:26:59 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-46480a0d-9bac-4080-9051-a0f6b290800e" returned: 0 in 0.898s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-46480a0d-9bac-4080-9051-a0f6b290800e" released by "delete_volume" :: held 2.383s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Created reservations ['5370b156-1b4d-436b-b82c-ff3c77490713', '476ad67a-abad-40bb-b734-c3b74cb17b48', '42c1c9b0-09b2-4b97-9ecd-0b097f0d5842', '711e2c20-388b-4a07-af9c-3ca380b87a8d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:26:59 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:26:59 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:26:59 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:00 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" returned: 0 in 0.686s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.image.image_utils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Image conversion details: src /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 {{(pid=82388) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 23:27:00 devstack cinder-volume[82388]: INFO cinder.image.image_utils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Converted 1024.00 MB image at 415.00 MB/s Apr 15 23:27:00 devstack cinder-volume[82388]: WARNING cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 is being set with open permissions: ugo+rw Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:00 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 Apr 15 23:27:00 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:00 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.481s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:00 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Deleted volume successfully. Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3fc0a392-ebd8-4c6e-80ef-a2868095441d tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-46480a0d-9bac-4080-9051-a0f6b290800e-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "cinder-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "cinder-quobyte-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[626531d7-1222-49f4-9f9a-d0ce49ef301d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:00 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962" returned: 0 in 0.490s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-8340282d-910f-48aa-91ca-c41d6710f962" released by "_copy_volume_from_snapshot" :: held 4.732s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" by "_delete_snapshot" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Deleting offline snapshot ae1e8b79-b28d-40f1-ae1e-57087e0a92aa of volume f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] snapshot_file for this snap is: volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa {{(pid=82388) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a83a12e-d01c-4c9a-8732-5d4da41b2788]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:00 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:00 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 Apr 15 23:27:00 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:00 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa Apr 15 23:27:00 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:01 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0" returned: 0 in 0.577s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:01 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0 Apr 15 23:27:01 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:01 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" returned: 0 in 0.617s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82388) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[afba076e-3cce-49c4-9c8b-e37c19924495]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:01 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed Apr 15 23:27:01 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:01 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0" returned: 0 in 0.461s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-quobyte-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0" released by "delete_volume" :: held 1.077s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Created reservations ['3277b8b3-9b6c-4eb1-ab91-927bec981ecb', 'e93a84c5-810e-4dc1-a9ba-a2480b4650d1', '6fa03549-770c-41e0-bd54-12b52d80fe08', '20545ae9-4306-441e-a886-a05ff4253886'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:01 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:01 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:01 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" returned: 0 in 0.551s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:01 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:01 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa Apr 15 23:27:01 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:02 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:02 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Deleted volume successfully. Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8af4cb64-58d9-4217-b223-4212399aa5a7 tempest-CinderUnicodeTest-1027587696 None] Lock "cinder-4420c1e4-1fcb-4b24-950c-b6f0168ba8d0-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:02 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" returned: 0 in 0.522s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:02 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa Apr 15 23:27:02 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:02 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed.ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" returned: 0 in 0.472s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-ae1e8b79-b28d-40f1-ae1e-57087e0a92aa" released by "_delete_snapshot" :: held 2.235s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.979s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.375s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1452738317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:26:53Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Creating volume 0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:27:02 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbbe95e-76a8-4918-a30f-4d15ef9b7151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8340282d-910f-48aa-91ca-c41d6710f962', 'volume_size': 1, 'source_volid': 'f9663ccc-a9bd-40d4-aeb6-f018dd1079ed', 'source_volstatus': 'available'}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:02 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 1073741824 Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56345b89-ccb5-4112-ab4d-457853c9ba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:02 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:02 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Volume volume-8340282d-910f-48aa-91ca-c41d6710f962 (8340282d-910f-48aa-91ca-c41d6710f962): created successfully Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56345b89-ccb5-4112-ab4d-457853c9ba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:02 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Flow 'volume_create_manager' (020d256a-551b-4215-b26c-4934cec84aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:02 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-d62561a4-1d45-4071-9b91-aa6ea3b8fbfd tempest-VolumeDependencyTests-2019173142 None] Created volume successfully. Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[b199c6e2-1909-4675-b75e-d28e3018364a]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:03 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed Apr 15 23:27:03 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:03 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 1073741824" returned: 0 in 0.598s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:03 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 Apr 15 23:27:03 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:03 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:03 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:03 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed Apr 15 23:27:03 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:04 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49" returned: 0 in 0.458s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666d58ac-fa87-4393-994b-eac6ef187fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62721bbf-1097-4354-8025-d515bb3a53ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 (0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49): created successfully Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62721bbf-1097-4354-8025-d515bb3a53ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (dbb81225-7df6-48b5-be5c-466c589402c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:04 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-a2e4c793-7195-4e3c-9e31-afb258d02c72 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created volume successfully. Apr 15 23:27:04 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (3124a767-93e6-4b99-a3b3-02777153c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a120f0aa-8be3-40ca-b23f-d8f3279f07e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" returned: 0 in 0.605s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed" released by "delete_volume" :: held 1.248s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a120f0aa-8be3-40ca-b23f-d8f3279f07e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240513920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782f79a0-a681-4d10-8a26-7dc45978b647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:04Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f2ec28-ef34-4ffb-88ff-134900f1fecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f2ec28-ef34-4ffb-88ff-134900f1fecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ff5525-b097-4912-8162-ff9c00e63073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ff5525-b097-4912-8162-ff9c00e63073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782f79a0-a681-4d10-8a26-7dc45978b647', 'volume_name': 'volume-782f79a0-a681-4d10-8a26-7dc45978b647', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21c4aab-e564-4aa2-b332-173cac72eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21c4aab-e564-4aa2-b332-173cac72eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c5a64c-4080-41fd-a385-d7a258081b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume 782f79a0-a681-4d10-8a26-7dc45978b647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782f79a0-a681-4d10-8a26-7dc45978b647', 'volume_size': 1} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240513920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782f79a0-a681-4d10-8a26-7dc45978b647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:04Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Creating volume 782f79a0-a681-4d10-8a26-7dc45978b647 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:27:04 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:04 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 1073741824 Apr 15 23:27:04 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Created reservations ['3f50da43-7043-494a-b9ed-823a8fa8d4e8', '8c2854ef-8012-4875-ac0c-d32065591317', 'e40c9de4-9750-4add-9d36-d0931167fb9a', '97dabfec-6de3-4bc7-9e05-abbf42f52a39'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:04 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:04 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (9c5f4edb-14d1-4944-b30d-6f4f7842fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a21a2a-5a5b-4402-90a6-929acd2378db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a21a2a-5a5b-4402-90a6-929acd2378db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-877682811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df1c25e-af73-4c4d-abd4-c394ba91bd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7629b5f5-e4ae-4b32-a5ad-a298a300d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7629b5f5-e4ae-4b32-a5ad-a298a300d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c253923-a2e8-46f4-9946-379757446bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c253923-a2e8-46f4-9946-379757446bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df1c25e-af73-4c4d-abd4-c394ba91bd64', 'volume_name': 'volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb51c0e3-deba-4330-9141-d347cf49c057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb51c0e3-deba-4330-9141-d347cf49c057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea359017-b0f2-4de3-a7ae-b1b344f0ef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:04 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume 7df1c25e-af73-4c4d-abd4-c394ba91bd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64', 'volume_size': 1} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:04 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (b47d1bee-cf88-4189-98f7-a2b4f90b08aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536a1071-46f5-408b-b465-8610bae3b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536a1071-46f5-408b-b465-8610bae3b22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75597197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163ef75a-8543-47c1-9a94-a352923856e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa81fc9-b9ad-4bcc-870a-86228c97d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa81fc9-b9ad-4bcc-870a-86228c97d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448f80a9-4067-4f2f-87b6-b543bd7149ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448f80a9-4067-4f2f-87b6-b543bd7149ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163ef75a-8543-47c1-9a94-a352923856e9', 'volume_name': 'volume-163ef75a-8543-47c1-9a94-a352923856e9', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a154b9d6-94ca-4570-86f3-8c32e879452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a154b9d6-94ca-4570-86f3-8c32e879452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a067992a-f963-4736-88fc-62e73c46f2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume 163ef75a-8543-47c1-9a94-a352923856e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163ef75a-8543-47c1-9a94-a352923856e9', 'volume_size': 1} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:27:05 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (73ae3ebf-09e7-4aae-9303-e5505dbd23d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a4a802-a1dc-41ac-8ddd-2556b40122a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.604s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a4a802-a1dc-41ac-8ddd-2556b40122a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697621863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962ecb19-e56c-436c-97ee-6338b1582f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dabd5f-4711-4f5a-9705-5c3fc9bde592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dabd5f-4711-4f5a-9705-5c3fc9bde592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f25929d-3859-4c3a-b04d-d7816accc5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f25929d-3859-4c3a-b04d-d7816accc5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962ecb19-e56c-436c-97ee-6338b1582f18', 'volume_name': 'volume-962ecb19-e56c-436c-97ee-6338b1582f18', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d04f75-e5c4-4476-b3c3-6417333eb760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d04f75-e5c4-4476-b3c3-6417333eb760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73ab1d6-81d8-40d7-a833-5966cba73126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume 962ecb19-e56c-436c-97ee-6338b1582f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962ecb19-e56c-436c-97ee-6338b1582f18', 'volume_size': 1} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Deleted volume successfully. Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-10d718d4-a90b-4bce-9df8-7d5bbcdc4d1f tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-f9663ccc-a9bd-40d4-aeb6-f018dd1079ed-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:05 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 1073741824" returned: 0 in 0.789s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:05 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 Apr 15 23:27:05 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.flows.manager.create_volume [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82388) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (2cbcaaf7-0e5c-41b0-8ded-53fefe67108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe03fea9-f8ec-4ff0-9015-fd5352fc2657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-8340282d-910f-48aa-91ca-c41d6710f962-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe03fea9-f8ec-4ff0-9015-fd5352fc2657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273141840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b20f07-b1b4-4c45-96f6-22ce935fc253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9ee6aa-c218-4991-9ac9-a0df3b6256df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9ee6aa-c218-4991-9ac9-a0df3b6256df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fd142b-e716-4416-8aec-cd8a11fb73a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fd142b-e716-4416-8aec-cd8a11fb73a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b20f07-b1b4-4c45-96f6-22ce935fc253', 'volume_name': 'volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd42ae98-bb53-44d8-b6d8-119188e0dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd42ae98-bb53-44d8-b6d8-119188e0dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef5fd6c-58f7-40d1-bb49-bd34b6a4ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume a0b20f07-b1b4-4c45-96f6-22ce935fc253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253', 'volume_size': 1} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-8340282d-910f-48aa-91ca-c41d6710f962-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-8340282d-910f-48aa-91ca-c41d6710f962" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-8340282d-910f-48aa-91ca-c41d6710f962" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3e1516-742f-4ab8-ab68-446ee5f86018]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:05 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 Apr 15 23:27:05 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:05 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647" returned: 0 in 0.493s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-877682811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df1c25e-af73-4c4d-abd4-c394ba91bd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Creating volume 7df1c25e-af73-4c4d-abd4-c394ba91bd64 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:27:05 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c5a64c-4080-41fd-a385-d7a258081b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782f79a0-a681-4d10-8a26-7dc45978b647', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 1073741824 Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ff1f46-d5fb-4ea5-80c1-e27433996f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:05 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:05 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume volume-782f79a0-a681-4d10-8a26-7dc45978b647 (782f79a0-a681-4d10-8a26-7dc45978b647): created successfully Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ff1f46-d5fb-4ea5-80c1-e27433996f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:05 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (3124a767-93e6-4b99-a3b3-02777153c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:05 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-37ae0a16-f5f4-460c-ac37-5adb50a1500f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created volume successfully. Apr 15 23:27:06 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962" returned: 0 in 0.525s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:06 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962 Apr 15 23:27:06 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:06 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 1073741824" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:06 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 Apr 15 23:27:06 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:06 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-8340282d-910f-48aa-91ca-c41d6710f962" returned: 0 in 0.475s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-8340282d-910f-48aa-91ca-c41d6710f962" released by "delete_volume" :: held 1.030s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Created reservations ['3843649d-25f8-41ef-8db1-05e9ca4058f3', '53554216-7496-4f19-b127-b89b35d1c5d6', 'addf143b-e23d-4d9a-810b-66ba7d819c01', '7d155cea-c407-4365-8dbc-6e4fa5619366'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:06 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:06 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:06 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64" returned: 0 in 0.430s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.764s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75597197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163ef75a-8543-47c1-9a94-a352923856e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Creating volume 163ef75a-8543-47c1-9a94-a352923856e9 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:27:06 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea359017-b0f2-4de3-a7ae-b1b344f0ef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29aadf6-6c5d-4330-8d7b-dbe18590a267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:06 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 1073741824 Apr 15 23:27:06 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:06 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 (7df1c25e-af73-4c4d-abd4-c394ba91bd64): created successfully Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29aadf6-6c5d-4330-8d7b-dbe18590a267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:06 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (9c5f4edb-14d1-4944-b30d-6f4f7842fb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:06 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-6e9e33ab-90dd-4d63-a091-46cc94787697 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created volume successfully. Apr 15 23:27:07 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.436s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Deleted volume successfully. Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-3ab4e760-4cc2-448d-ac92-7aec73648c5a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-8340282d-910f-48aa-91ca-c41d6710f962-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:07 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 1073741824" returned: 0 in 0.497s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:07 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 Apr 15 23:27:07 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-645fd9e9-e625-43e4-a10b-17952ad34cf1-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-645fd9e9-e625-43e4-a10b-17952ad34cf1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "cinder-quobyte-645fd9e9-e625-43e4-a10b-17952ad34cf1" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-645fd9e9-e625-43e4-a10b-17952ad34cf1" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e4fc29-3cdc-4336-ba32-996356965104]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:07 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9" returned: 0 in 0.442s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697621863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962ecb19-e56c-436c-97ee-6338b1582f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Creating volume 962ecb19-e56c-436c-97ee-6338b1582f18 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:27:07 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a067992a-f963-4736-88fc-62e73c46f2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163ef75a-8543-47c1-9a94-a352923856e9', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:07 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 1073741824 Apr 15 23:27:07 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6263362c-20ac-4c0b-8eed-b9755e4e1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:07 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume volume-163ef75a-8543-47c1-9a94-a352923856e9 (163ef75a-8543-47c1-9a94-a352923856e9): created successfully Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6263362c-20ac-4c0b-8eed-b9755e4e1ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:07 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (b47d1bee-cf88-4189-98f7-a2b4f90b08aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:07 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 Apr 15 23:27:07 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:07 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-20884e6d-a4d1-4c71-8f73-210c307d7fc2 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created volume successfully. Apr 15 23:27:08 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1" returned: 0 in 0.471s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:08 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1 Apr 15 23:27:08 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:08 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 1073741824" returned: 0 in 0.491s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:08 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 Apr 15 23:27:08 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:08 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-645fd9e9-e625-43e4-a10b-17952ad34cf1" returned: 0 in 0.415s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-quobyte-645fd9e9-e625-43e4-a10b-17952ad34cf1" released by "delete_volume" :: held 0.924s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Created reservations ['7c4983df-d23d-4022-8ca1-d5c88b90a6c5', 'af31570e-2e98-4433-b4d2-40d728a55fb6', '58d35ef6-b21e-4d83-9667-671742ee5b7a', '55c5f74f-0a99-475c-8efc-096f6d476ee2'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:08 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18" returned: 0 in 0.428s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.199s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273141840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b20f07-b1b4-4c45-96f6-22ce935fc253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab3e231b98244549ca390ec2e2bf0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T21:27:05Z,use_quota=True,user_id='9d58df0f274040599ed5710064d5d3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(597a8bc1-7296-4238-a309-f460c6c831ed),volume_type_id=597a8bc1-7296-4238-a309-f460c6c831ed)}" {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.remotefs [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Creating volume a0b20f07-b1b4-4c45-96f6-22ce935fc253 {{(pid=82388) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Selected osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 as target Quobyte volume. {{(pid=82388) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 23:27:08 devstack cinder-volume[82388]: INFO cinder.volume.drivers.remotefs [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] casted to osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037 Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 1073741824 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73ab1d6-81d8-40d7-a833-5966cba73126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962ecb19-e56c-436c-97ee-6338b1582f18', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c349d3e-4e62-45f3-9657-1f1c6953d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:08 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 1073741824 Apr 15 23:27:08 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:08 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume volume-962ecb19-e56c-436c-97ee-6338b1582f18 (962ecb19-e56c-436c-97ee-6338b1582f18): created successfully Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c349d3e-4e62-45f3-9657-1f1c6953d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:08 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:08 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:08 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (73ae3ebf-09e7-4aae-9303-e5505dbd23d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:08 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-92dd9463-fc40-4a4f-869a-5ba675eb23fd tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created volume successfully. Apr 15 23:27:09 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.506s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:09 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Deleted volume successfully. Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-8c88ec1d-3143-4272-8e8d-1846242c401a tempest-VolumeDependencyTests-2019173142 None] Lock "cinder-645fd9e9-e625-43e4-a10b-17952ad34cf1-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:09 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 1073741824" returned: 0 in 0.623s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:09 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 Apr 15 23:27:09 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:09 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253" returned: 0 in 0.488s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'} {{(pid=82388) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef5fd6c-58f7-40d1-bb49-bd34b6a4ca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253', 'volume_size': 1}' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49f0546-56c0-4947-a63e-e61067f33fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 23:27:09 devstack cinder-volume[82388]: INFO cinder.volume.flows.manager.create_volume [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Volume volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 (a0b20f07-b1b4-4c45-96f6-22ce935fc253): created successfully Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49f0546-56c0-4947-a63e-e61067f33fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82388) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 23:27:09 devstack cinder-volume[82388]: DEBUG cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Flow 'volume_create_manager' (2cbcaaf7-0e5c-41b0-8ded-53fefe67108c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82388) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 23:27:09 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-591a1b6b-5b57-40d8-83c9-9dc05ad4c3e3 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created volume successfully. Apr 15 23:27:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-a0b20f07-b1b4-4c45-96f6-22ce935fc253-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-a0b20f07-b1b4-4c45-96f6-22ce935fc253-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-quobyte-a0b20f07-b1b4-4c45-96f6-22ce935fc253" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:10 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-a0b20f07-b1b4-4c45-96f6-22ce935fc253" acquired by "delete_volume" :: waited 0.007s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:10 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f67835-ded1-4c62-a00c-2b19eb11f076]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:10 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:11 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 Apr 15 23:27:11 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:11 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253" returned: 0 in 0.467s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:11 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253 Apr 15 23:27:11 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:11 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-a0b20f07-b1b4-4c45-96f6-22ce935fc253" returned: 0 in 0.408s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-a0b20f07-b1b4-4c45-96f6-22ce935fc253" released by "delete_volume" :: held 0.898s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:UPDATE=257,cinder:SELECT=189,cinder:INSERT=55,cinder:DELETE=20 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=189,cinder:UPDATE=254,cinder:DELETE=28,cinder:INSERT=69 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created reservations ['0248ebd3-280a-4bb9-b92b-fa78cbb0307b', 'f451bf20-930a-4e44-bf7d-c5b797b4f92b', '3e8086ee-6a47-4e72-a0ef-ca71808e3942', '2c92ef89-dfc5-485a-8dda-4a778e49be2c'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:11 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:11 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:11 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-962ecb19-e56c-436c-97ee-6338b1582f18-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-962ecb19-e56c-436c-97ee-6338b1582f18-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-quobyte-962ecb19-e56c-436c-97ee-6338b1582f18" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-962ecb19-e56c-436c-97ee-6338b1582f18" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf9d9a-fadf-407d-822c-756ec927e95d]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:12 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 Apr 15 23:27:12 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:12 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.435s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:12 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Deleted volume successfully. Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-fb8505a5-6ef9-40e0-a661-a9932297bb26 tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-a0b20f07-b1b4-4c45-96f6-22ce935fc253-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:12 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18" returned: 0 in 0.454s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:12 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18 Apr 15 23:27:12 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:12 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-962ecb19-e56c-436c-97ee-6338b1582f18" returned: 0 in 0.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-962ecb19-e56c-436c-97ee-6338b1582f18" released by "delete_volume" :: held 0.885s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created reservations ['3a039455-63ba-4deb-a165-8abdeaa8bbaf', '6be02124-0fa6-40d7-b0fa-53f4bac1bc8f', '1164aa95-999f-42ca-b837-95a01de4b4b9', '2f6d8185-cf24-4040-835d-fe6b654ccd92'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:12 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:13 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:13 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-163ef75a-8543-47c1-9a94-a352923856e9-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-163ef75a-8543-47c1-9a94-a352923856e9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-quobyte-163ef75a-8543-47c1-9a94-a352923856e9" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-163ef75a-8543-47c1-9a94-a352923856e9" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca47e99c-85b3-43d4-a6d3-6f681c7a4ead]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:13 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 Apr 15 23:27:13 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:13 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.438s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:13 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Deleted volume successfully. Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-983b3dc2-0b59-4bd0-b993-662c07bd0b4e tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-962ecb19-e56c-436c-97ee-6338b1582f18-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:13 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9" returned: 0 in 0.480s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:13 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:13 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9 Apr 15 23:27:13 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:14 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-163ef75a-8543-47c1-9a94-a352923856e9" returned: 0 in 0.405s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-163ef75a-8543-47c1-9a94-a352923856e9" released by "delete_volume" :: held 0.913s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created reservations ['e4f85a57-812b-495b-b587-2b7b138e25a5', 'db2736b0-72a3-4fe6-a7b0-6be364d919ab', 'aad1f0e6-d768-4458-ac7a-2c58c8df9fe7', 'ca6c1fe0-a91f-42d5-98ef-cf5289a2c10d'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:14 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:14 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-7df1c25e-af73-4c4d-abd4-c394ba91bd64-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-7df1c25e-af73-4c4d-abd4-c394ba91bd64-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-quobyte-7df1c25e-af73-4c4d-abd4-c394ba91bd64" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-7df1c25e-af73-4c4d-abd4-c394ba91bd64" acquired by "delete_volume" :: waited 0.008s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba6402-53d6-4cd3-a3da-fe1125365102]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:14 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 Apr 15 23:27:14 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:14 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.409s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:14 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Deleted volume successfully. Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-09220c72-f8ae-4b5a-a060-218b0e7f5ffb tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-163ef75a-8543-47c1-9a94-a352923856e9-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:14 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64" returned: 0 in 0.488s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:14 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64 Apr 15 23:27:14 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_service.periodic_task [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82388) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:14 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:14 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:14 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:15 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-7df1c25e-af73-4c4d-abd4-c394ba91bd64" returned: 0 in 0.419s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-7df1c25e-af73-4c4d-abd4-c394ba91bd64" released by "delete_volume" :: held 0.937s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:15 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created reservations ['580de5ce-2ab3-47c4-bfe8-8fae25814266', '2303c5ca-6313-47f8-9e2f-7514f940efbc', '3dc815ce-fbd3-4ddc-be83-74ad6dcab354', 'd17ba19c-cab4-4d9b-983d-454289995f0c'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.441s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-de00ff30-4caf-414f-8411-c2a239235364 None None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:15 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:15 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-782f79a0-a681-4d10-8a26-7dc45978b647-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-782f79a0-a681-4d10-8a26-7dc45978b647-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-quobyte-782f79a0-a681-4d10-8a26-7dc45978b647" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-782f79a0-a681-4d10-8a26-7dc45978b647" acquired by "delete_volume" :: waited 0.006s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f1afc-4008-4327-8cd0-ea3bfa2f9ed4]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:15 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 Apr 15 23:27:15 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:15 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.427s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:15 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Deleted volume successfully. Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-b641cd90-528f-4ad4-9ce1-b1ec7e03830a tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-7df1c25e-af73-4c4d-abd4-c394ba91bd64-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:15 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647" returned: 0 in 0.466s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:15 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:15 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647 Apr 15 23:27:15 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:16 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-782f79a0-a681-4d10-8a26-7dc45978b647" returned: 0 in 0.428s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-782f79a0-a681-4d10-8a26-7dc45978b647" released by "delete_volume" :: held 0.915s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created reservations ['3b22346d-5c58-4fd0-a46b-d100cee77bc7', '15676062-d38c-4b3c-8d97-2d52ec5b6779', '00ab3b56-ef6e-4e95-90ea-5a31afc2b53e', '83eaea17-49c9-4bea-b280-cf5112aad7d5'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:16 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:16 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49-delete_volume" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "cinder-quobyte-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49" by "delete_volume" {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49" acquired by "delete_volume" :: waited 0.011s {{(pid=82388) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f72be-9e13-45c8-a7e8-dece2b463e87]: (4, 'qcow2') {{(pid=83406) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:16 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 Apr 15 23:27:16 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:16 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.421s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:16 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Deleted volume successfully. Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-ffa086a0-7b03-4ff4-a39b-e9f5cc934edc tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-782f79a0-a681-4d10-8a26-7dc45978b647-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:16 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49" returned: 0 in 0.463s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:16 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:17 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49 Apr 15 23:27:17 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:17 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6/volume-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49" returned: 0 in 0.391s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-quobyte-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49" released by "delete_volume" :: held 0.875s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG cinder.quota [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Created reservations ['fb5b0e18-60ef-4787-a7be-d3751e821c7a', '78bc1b01-7f0e-4626-bdda-ff9be4af0bef', '1eff9035-d294-4e05-b19f-a8b8e40fb181', 'e01dfef0-ea2e-4184-a921-3642c1eb6e02'] {{(pid=82388) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037': None} {{(pid=82388) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG cinder.volume.drivers.quobyte [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-00b19025-1791-4f30-a320-6a48f253c037'] {{(pid=82388) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.lockutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82388) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 23:27:17 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6 Apr 15 23:27:17 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 23:27:17 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG oslo_concurrency.processutils [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/449282d5e0f5f73645b4557a6eb711d6" returned: 0 in 0.460s {{(pid=82388) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG cinder.manager [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Notifying Schedulers of capabilities ... {{(pid=82388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 23:27:17 devstack cinder-volume[82388]: INFO cinder.volume.manager [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Deleted volume successfully. Apr 15 23:27:17 devstack cinder-volume[82388]: DEBUG cinder.coordination [None req-7f2853b7-0cb6-4300-abf9-bef7ad951a8f tempest-CreateVolumesFromSourceVolumeTest-460066963 None] Lock "cinder-0cfcb43c-40b0-4c39-9ea1-dd26ce59ce49-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82388) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 23:27:27 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:SELECT=28,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=9 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 23:27:27 devstack cinder-volume[82388]: DEBUG dbcounter [-] [82388] Writing DB stats cinder:INSERT=12,cinder:UPDATE=39,cinder:SELECT=25,cinder:DELETE=2 {{(pid=82388) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}